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ABSTRACT 

Suggestions for integrating computer technology and 
composition instruction are presented in four conference papers, 
summaries cf four Conference courseware demonstrations, a paper 
describing computer-based evaluation of textual responses, and a 
reactor's address. \ln an overview of the current state of 
computer-based composition instruction, Robert Shostak discusses the 
problems that writing teachers have traditionally faced and offers 
some promising solutions. Hugh Burns then describes a computer-based 
dialog designed to assist students in generating writing ideas, during 
prewriting. Earl Woodruff discusses the role 4 that computers can play 
in helping students compose text, and Ann Lathrop presents criteria 
for consideration when selecting courseware for purchase. The varied 
courseware materials demonstrated at the conference are then 
described. The conference reactor, Alfred Bork, suggests principles 
that should guide the development of computer-based learning 
materials and stresses the need for a < solid research foundation. In 
an appendix, the editor outlines problems that instructional 
developers may encounter in designing programs for teaching writing 
and discusses the need for interactive programs that can evaluate the 
form and content of textual responses. (LMM) 



v 



*************************** 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 
***************** *** *********** **************************************** 



rsj 



U S. DCPARTMCNT OF EDUCATION 

NATIONAL INSTITUTE 0 F EOUCATION 

EDUCATIONAL f cSOURCES INFORMATION 

CENTER IERICI 
f* Th* document has been reproduced as 

received from the person or organwtfon 

originating it 

Minor changes have been nude to improve 
reproduction qui?«ty 



1 Points of view or op>n»ons stated «n this docu 
ment do not necessary represent official NIE 
position or policy, , 



COMPUTERS IN COMPOSITION INSTRUCTION 



The proceedings of a research/practice conference 
held at SWRL_Educational Research and Develop- 
ment, Los Al ami t os, California, April 22-23, 1982. 



N 



Edited by 
Joseph -Lawlor 



"PERMISSION TO REPRODUCE THIS 
MATERIAL IN MICROFICHE ONLY 
HAS BEEN GRANTED BY 



Joseph Lawlor 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)." 



"' I- 



SWRL Education! J Research and Development 
4665 Lampson Avenue 
Los Alamiios, CA 90720 
© 1982 



The materia! in this publication was prepared under a contract with 
the National Institute of Education* Department of Education. Its 
contents do not necessarily reflect the views of the National Institute 
of Education or of any other agency of the United States Government. 



CONTENTS 



Page 



latrodactioa * * 

Computer-Assisted Composition Instruction: 
The State of the Art ^ 
Robert SaotUk ~ 5 

Computer-Assisted Prewriting Activities: 
■ - Harmonics for Invention 

High fens *. 19 

Computers and the Composing Process: « 
/4n Examination of Computer-Writer Interaction 
EariWoodraff 31 

Courseware Selection c 
Abb Latar jp 47 * 



Cdamware Demoaitratioas 



61 



Reactions 

Alfred Bork 



67 



Appeadix: Evaluating Textual Responses 
Joseph Lawlor 



75 



Biographical Notes 



PartklpaaU 



9 

ERIC 



l 

4 ' 



INTRODUCTION 



Recent advances in computer technology are bring- 
ing about dramatic changes in education. Surveys 
indicate that school districts across the country are 
investing in microcomputers, peripheral devices, and 
educational software at an ever increasing rate. 
Clearly, the electronic revolution in education is no 
longer something that exists in the distant future. It 
is a reality now; 

Interestingly, these developments in the r field of 
computer-based learning are paralleled by similar 
advances in composition research, which is currently 
providing new Insights into the complex processes that 
writers employ as they compose written text. And prac- 
titioners are using this research as a, basis for devel- 
oping new strategies for teaching writing. 

What are the connect ions, though, between these 
two seemingly dissimilar fields— computers and writing? 
On April 22-23, 1982, the Southwest Regional Laboratory 
for Educational Research and Development (SWRL) spon- 
sored a conference to examine the role of computers in 
composition instruction. This book Includes five 
papers that were presented at the conference. Also 
included are summaries of courseware demonstrations 
held at the conference, as well as a description of 
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SWRL's work in developing computer-based materials for 
teaching wr It ing. 

The first paper in the volume provides an overview 
of the current state of computer-based composition 
instruct ion. Robert Shostak discusses the problems 
that writing teachers have traditionally faced and 
describes some ''promising practices 11 that may nelp 
overcome these problems. 

Hugh Burns describes a computer-based dialogue 
that he developed, to -assist students in generating 
ideas for writing.* Earl Woodruff discusses the role 
that computers can play in helping students compose 
text. Ann Lathrop outlines criteria that should be 
considered v/hen selecting courseware for purchase. 

The courseware demonstrated at the conference 
included a variety of materials. Descriptions are 
provided for programs demonstrated by hichael South- 
well, Stephen Marcus, Irene and Owen Thomas, and 
Shirley Kerari. 

Alfred Bork served as the reactor For the confer- 
ence, and his presentation includes a discussion of the 
principles that should guide the development of com- 
puter-based learning materials. He also discusses the 
need for a solid research foundation. 

In an appendix to the book, the editor describes 
some of the problems that instructional developers are 
likely to encounter as they design programs for teach- 
ing writing. The paper discusses the need for inter- 
active programs that can evaluate the form and content 
of textual responses. 

The purpose of this book is to present some new 
ideas fpr integrat ing computer technology and compo- 
s it ion instruction. The programs described here sug- 
gest that computers can be useful tools for teaching 
writing. However, we must remember that computer -based 
omposition instruction is a new development--one that 
ik likely to experience the "growing pains" associated 
with any new endeavor. In the course of developing 
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computer-based writing materials, designers will un- 
doubtedly test, revise, refine, and, perhaps, discard a 
variety of instructional strategies. Consequently, the 
work described in this book represents only a begin- 
ning. But it .is our hope that this beginning will 
stimulate additional efforts— efforts to improve com- 
position instruction, and, ultimately, to improve 
students 1 writ inc 



Joseph Lawlor 
SWRL Educational Research 
and Development 



ERLC 
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COMPUTER-ASSISTED 
COMPOSITION INSTRUCTION: 
THE STATE OF THE ART 



Robert Soostak 
Florid* lateraatloaal UaWeralty 



D 

I believe that any 'state-of-the-art discussion 
related to computer-assisted composition instruction 
should consider first some of the general problems we 
face in teaching writing. We all know that the latest 
in the litany of things that Johnny (and Jane) can't do 
is write. We know this because Time and Newsweek have 
told us it is so; As professional teachers we have 
known what the pedagogical problems are for a long, 
Jong time. * 

*» 

Teachers of writing have-always faced the problem 
"of numbers. A writer needs an audience. Being the 
reading audience for between 100 and 1 80 * English stu- 
dents in a typical secondary school is not my idea of 
an ideal situation for teaching writing. J grow tired 
of trying to fool my undergraduates and experienced 
teachers at in-service workshops by attempting to make 
this burden seem insignificant and then selling them orr 
"cutesy" ideas for surmounting the task of reading a 
seemingly endless number of student papers. 



The State of the An | 

The crowded curriculum Is another serious problem 
that detracts from the teaching of writing* Elemen- 
tary school teachers complain of the need to empha- 
size the basic skills of reading and arithmetic, while 
the teaching of writing competes, in \ the little time 
remaining., with science, socia 1 studies, art, music, 
health, career explorat ion, and what nave you* Sec- 
ondary English teachers echo similar complaints* Host 
owe their al legiance to 1 iterature butl must also f ind 
time for basic skills, film, TV, language study, and 
writing* 1 



Lastly and reluctantly, I must question our teach- 
ing practices in general. In a recent article, Anthony 
Petrosky cites compelling research that indicates that 
teachers tend 

to monopolize * * * classes . . . with talking and 
writing • ^ • while . \ . students listen, regur- 
gitate, and 'seldom engage in meaningful discus- 
s ions or compos it ions that are free of h idden 
agendas and require the critical thinking skills 
of interpretation, judgment, analysis, synthesis, 
and documentation with evidence* ( Engl ish Educa- 
tion , February, 1982) 

I think Petrosky^s right* We have fallen in with 
a system that emphasizes product over process* We, go 
for the f i 1 1-In-the-blank or multiple-choice type of 
assessment* We engage students in exerc ises that are 
purported to teach wr i t ing but are actual ly easy-to- 
grade substitutes for the real thing. 

We have other problems. In the introduction to 
Research on Composing: Points of Departure (National 
Council of Teachers of Engl ish, 1978), the editors, 
Charles Cooper and Lee Odell,, challenge the basic 
assumption that teachers of writing have £n adequate 
understanding of the term compos it ion* . They point to 
the work of Richard Meade and W. Geiger Ellis, who 
discovered that paragraph developments as taught in 
textbooks could not be found in a large number of 
actual pieces *of writing they examined. Cooper and 
Odell also cite Richard Braddock's study, which chal- 
lenges certain conventional assumptions about the 
^.ime-honored use of the topic sentence--a technique 
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that recently has found its way down to the more pres- 
tigious suburban preschools. The editors also refer to 
Janet Erijig's work, which poses a- serious challenge to 
the admonition of every true bel fever that thou shalt 
not write before producing a complete outline. 

> 

My point here is that researcliers who have system- 
atically investigated the nature of the writing process 
and professional writers who have expressed their own 
thoughts about what happens when they write have not 
only caused us to reconsider our own views but have 
also provided us with new insights to understand the 
act of composing. 

Research tells us that rather than teach writing 
as a set 'of discrete skills (which, when learned in 
some predetermined scope and sequence, will eventually 
become internalized to be applied to the task of 
writing) we need to teach writing as a process. We 
need to guide the developing writer carefully through 
the stage of prewriting, into the act of composing, and 
finally through the difficult period of rewriting and 
editing. 

I mention these general problems at the outset asr$ 
a word of caution. We cannot look at computer-assisted 
instruction as a panacea. Teachers are not going to 
become good writing instructors simply because they 
have a unique new technology available to them. They' 
must first understand what it means to be a writer— to 
experience both the pain and the joy. They must under- 
stand the process, and they must be able to integrate . 
the latest innovations in instructional technology into 
an already sound writing program. 

It is probably much too early to talk about the 
state of the art in computer-assisted compos it fon 
teaching. To me; state of the art suggests that the 
latest product, process, or technique has been preceded 
by at leas^ one working model — itself the result of 
long-term planning, development,- and field-testing. At 
this point in time, I believe that practitioners are 
just beginning to produce the first working models. 
Some may call them state of the art if they wish — I 
prefer to describe them as promising practices. 
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What then are these promising practices? For pur- 
poses of organization I would like to refer first to 
those kinds of programs that seem to best support the 
first stage of the composing process, prewriting, then 
move on \ to the writing stage Itself, and finally ex- 
plore those programs d irected at the last stage, 
rewriting and editing. 

PREWRITING < 
Story Maker 

What appears to be an except ional 1y promis ing 
piece of programming for teaching writing in the ele- 
mentary school has been produced by Andee Rubin of 
Bolt, Beranek and Newman, Inc., a Boston educational 
consulting firm. The program is called Story Maker 
and focuses on the prewriting stage of the' writing 
process— invent ion. I like Story Maker because instead 
of emphasizing drill with letters, words, or phrases, 
it encourages children to concentrate on a whole text. 
More specifically, children are, guided to consider the 
logical flow of a narrative, the role of examples in an 
explanation, and the communication of characters 1 plans, 
in a story. 

The theoretical basis for this approach is found 
in cognitive psychology's investigation of children's 
writing and reading. Studies have shown that children, 
when faced with high-level cognitive tasks, tend to 
concentrate on lower- level processes such as decod Ing 
in reading, or spelling and handwriting in composing* 
Story Maker attempts to free young learners from atten- 
tion to these details so that they may concentrate on 
higher-level cognitive processes. 

Basically, the program engages students m a cre- 
ative story-making exercise by allowing them to choose 
options from al/eady written story segnjents. After all 
the decisions have been made, the child has produced a 
complete story which he or she can read and share with 
other students* The program also allows hard copy to 
be printed for further activities planned by the 
teacher. 
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What I especially like 'abolit this piece of 
courseware is that the child maintains control o£ the 
creative process while the computer handles Jthe "book- 
keeping 11 details. Through simple commands, the com- 
puter presents structured -optjons to the child, keeps 
track^ of the choices, and 'displays and prints the 
completed story when the activity is finished. 

The child controls the direction the story will 
take through the. choices he or she makes. Very early 
in the program the child begins to learn that making 
one choice rather than another will influence how the 
story will flow as well as how it will end. Because 
this program provides an early experience with manip- 
ulating language at a high cognitive level, it seems to 
have a great deal of promise for developing the kinds 
of skills one needs to become an effective writer. 

Aristotle's Topics 

Another example of courseware that reflects the 
process approach to the teaching of composition is that 
developed by Hugh Burns of the Air Force-Acadefiry En- 
glish Department.* Burns found that many of his fresh- 
man cadets were having a great deal of trouble at the 
pre-writing stage. They did not seem to have the time 
or ability to generate the ideas necessary as a precur- 
sor to composing. 

To help his students become more product ive at 
this preliminary stage of the writing process, Burns 
developed a computer-assisted program that permits stu- 
dents to interact with the computer for the purpose of 
stimulating the formation of ideas. The program uses a 
set of questions based on Aristotle's enthymeme topics 
to engage the student in a Socrat fc-type dialogue. The 
dialogue guides students through an explanation of 
their subjects in order to uncover new ideas, facts, 
opinions, or arguments that heretofore they were unable 
to recover from memory. 

*See p. 19 for further discussion of Burns 1 pro- 
gram. 
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I see this as a promising- practice because Burns 1 
findings suggest that* students .can/ be * encouraged to 
increase the number and sophistication of their ideas, 
-and that dialogue can help students express ideas more 
clearly. Any computer-ass is teil instruction that is 
effective in improving students/ sk II Is of Inquiry will 
be' welcomed by teachers of composition, 

COMPOSING 
Word Processors 

The composing stage of the wr it ing procf > j i s 
beginning to benefit greatly from several unique com- 
puter applications, although, strjctly sj>eaking, these 
appMcat ions might not be defined as computer-assisted 
if)s; .action* It is no longer a secret that 'computer- 
ized word processing has become an irrporfefit writing 
aid for authors, researchers, teachers, and students. 
The ease with which word-processing ^packages assist 
writers in creating and editing text^even to the point 
of checking syntax and spelling, can all but eliminate 
the need for typewriter^ pens, pencils, and" all/the 
rest of the usual paraphernalia associated with the 
tedious task of editing. 

Creative teachers of writ ing ^have* found sTeveral 
very effective uses. for word process mg. Children at' 
the elementary school level who find t*e production pf 
handwritten text both difficult and painful are being* 
taught to master the computer keyboard, making entry of 
text mu<:h simpler and freeing children to concentrate 
on the creative aspects of writing. 1 

One of the most difficult tasks of a writing 
teacher is to convince students that revision is impor- 
tant. As a general rule, students belieye that what 
flows from their pens the first 'time is exactly what 
they want to say and how they want to say it. Why 
tinker with perfection? Now teachers are reporting 
that students introduced to the power of word pro- 
cess ijig are beginning to take more kindly to revision. 
The ease with which words, sentences, and even entire 
paragraphs can be deleted, inserted, and shifted around 
h*4 helped students gain a greater understanding of and 
i /->>rec iat ion for the value of rewriting. 
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Research has for a long time suggested that to 
improve writing, one needs to write. Tor several rea- 
sons, all of them well known to experienced classroom* 
teachers, it is diff iculr*$or students to- produce the 
number and variety of composition assignments neces-, 
sary. Current reports suggest that the use of word > 
processing in teaching writing is .beginning to encour- 
age students to compose « more and' longer texts. 
Although there Ms no clear J cut evidence yet that stu- u 
dents are writing better^ the motivation to writ; is 
high,* and students 1 affect ive* responses to writiny 
assignments are positive. , 

Compupoem / 

I Working in the second stage of the writing pro- 
cess, composing, but coming at it from .another direc- 
tion are two poets who have developed different 
approaches to teaching ^writing. . BQth techniques 
deserve serious consideration by teachers of writing. 

The first one was developed by Stephen Marcus of 
the University of California, Santa Barbara.* Marcus 
has produced a pop try-wr Lt ing program called Compupoem , 
which engages students ill all stages of the composing 
process. Unlike\many poem-generating programs that 
simp i / produce a^ poem from a data bank of poetic 
phrases randomly displayed, Compupoem asks students for 
choices. The program encourages students to think 
abo'it what they want to say, and it .even provides the 
opportunity to see instant reproductions of their poems 
in different formats. 'This computer-assisted approach 
to wr.it ing poetry -permits students to generate ideas or 
think about what they want to say first. In v addition, 
students can control how the various parts of the poem 
will' fit together in the finished product. 

} 

The Electric Poti 

The second poetry 'program I would. like to discuss, 
was developed .by Edmund Skel lings, director of the 
International' Institute for Creative Communication at 4 



*See.p. 62 for additional information. 
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Florida International University. It takes the form of 
a very sophisticated piece of software called The Elec- 
tric Poet . 

For several years, Skel lings rjas been working on a 
computer program that would display color-paired sym- 
bols, numbers, x and letters, using an ordinary color 
television screen. He was recently awarded a patent 
for the process, which he calls the Binemic System. 
What the system does Is to permit color to be placed on 
a video screen to produce color pairs or groups illus- 
trating relationships between letters or symbols. 

♦ * 

Other features of the system include the capabil- 
ity of displaying letters in an infinite variety of 
patterns on the screen (similar to the patterns e.e. 
cummings uses on the printed page) and producing ani- 
mation. Thus, a poet can easily use a particular 
pattern for* displaying words while at the same time 
controlling when, where, and how quickly these words 
will appear to the reader experiencing the poem. To 
add to the flexibility of the display, letters may be 
made to appear as if they are three-dimensional on the 
screen. ■ 



.What Skellings has accomplished is a blissful mar- 
riage of technology .and poetry to produce a truly 
unique literary experience. Perhaps a 'more appropri- 
ate term might be a n li termedia" experience. Skellings 
has released poetry from the limitations of the one- 
dimensional, black and white printed page. He has 
added a powerful new dimension to the creative process, 
increasing the poet's opportunity to appeal to multi- 
sensory experiences. 

Skel ling's computer poem, then, is one that is 
viewed rather than read or heard. It may be seen in 
various colors. It may appear on the sceen in its 
entirety or take advantage of the time dimension and be 
displayed word by word, letter by tetter, or thought by 
thought. Finally, the poem may even appear to move as 
it is presented on the screen. Computer poetry, for 
me, exemplifies the new rapprochement of technology and 
the humanities that we are seeirvg today in numerous 
university programs around the country. 
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SkeHings believes thSt his Binemic System also 
has many pract ica 1 appl icat ions for educators, espe- 
clally those who teach language arts. He bases this 
belief on studies done by researchers in brain function 
imbalance, it Is pretty well accepted now that the two 
halves of the brain control different functions— the 
left hemisphere specializing Jn spoken language, read- 
ing, and writing; the right hemisphere dealing with 
spatial relations and musical patterns. Skelling says 
that when both parts of the brain are, fully activated 
and integrated with each other, optimal conditions for 
creat ivity exist. / 

Consequently, teaching methodology using the Bine- 
mic System can engage both brain hemispheres because it 
simultaneously displays text in a /linear-sequential 
format and in a color pattern-recognltjion format. Such, 
methodolojgy produces optimal conditions for effective 
learning to take place. 

Specific subject matter that Stel lings would like 
to develop for field-testing his system includes figu- 
rative language, patterns of thought,j poetry, grammar, 
and reading. He thinks that students who understand 
various kinds of figurative languag^ will be able to 
make comparisons more vividly. Such students will al^o 
have options for using more than literal language in 
describing and . in ^ understanding descriptions. 
Sktefflngs suggests using his prograjn to define and 
illustrate by color-coding various figures of speech. 

Because critical thinking is $o important to 
becoming a wise consumer and thoughtful voting citizen, 
Skel lings also hopes that teachers willj use his program 
to color rhetorical devices used in advertising, per- 
suasive writing, and political campaigns so that these 
devices may be identified, defined, land studied to 
determine their effect. \ 

Another effect ive use of th is program could be 
illustrating, by means of color analysis, the various 
pattern:* of thought writers use to.expresi their Ideas, 
i.e., exposit ion, persuas ion, descr Ipt ion, and narra- 
tion. Many possibilities exist for developing color- 
coded writing models that could be visually taken apart 

13 
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and put together, again instantly by the computer— a 
powerful tool for the teaching of writing. 

Skel 1 ings has already demonstrated the vi.abi lity 
of color-coding poems so that students can recognize 
the elements that lend meaning tu poetry. This ap- 
proach very effectively illustrates the relationship of 
language links and structure to meaning. 

REWRITING AND EDITING 

' Next, let me describe for you what 1 think are 
some of the most promising practices for teaching the 
last stage of the writing process — rewriting and edit- 
^^fng.-^JLach , program in this last group either deals 
directly^wTttr^text^hat has already been created and 
needs to be revised, or may be used to help students 
develop a higher level of sophistication with specific 
skills they have already demonstrated in tneir writing. 

The Navy Programs 

The first program 1 would 1 ike to discuss deals 
with two important elements of wr it ing--organ izat ion 
and development of style. Robert Wisher of the Navy 
Personnel Research and Development Center in San Diego 
has been working on both reading and writing programs 
over the past several years. One of his computer- 
ass is ted programs leads students through a procedure 
for organizing sentences into a meaningful paragraph. 
Students are presented with severa 1 sentences, each 
pr?ba4gd by a number. Fi rst , students must i dent if y 
wh ich of the sentences they bel ieve to be the top ic 
sentence. Then they rearrange the remaining sentences 
by selecting the numbers preceding each sentence. The 
computer instantly displays the organized paragraph. 
Next, students are allowed to edit their paragraphs in 
a variety of, ways in order to clarify meaning and pro- 
vide sty 1 ist ic effects. Th is is accompl ished by a 
series of prompts that allow students to position the 
top ic sentence, place short sentences oefore longer 
ones, delete unimportant sentences, and insert e single 
sentence of their own. v 
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Wisher also developed a program to assist students 
in developing better control over a variety of sentence 
constructions. The program is. based on some of the 
sentence-comb in ing research conducted over the past 
several years. Simi lar to the_ paragraph-organization 
programs, th is p iece of computer-ass is ted instruct ion 
has the student combine phrases into meaningful sen- 
tences. The s.tuden* can see immediately how phrases 
can be combined to form clauses, and how clauses can b, 
combined to form sentences. There, is even an option 
built into the program that allows the student to write 
a sentence with a particular style, for example, a sen- 
tence that begins with a specific verbal phrase or that, 
contains both a dependent and independent clause. Both 
of these programs help a student to understand the 
orgjn izat ional aspects of wr i t ing and apprec iate' the 
stylistic opt ions topen to the writer. 

SWRL 

Others working along similar lines are Bruce 
Cronnell, Ann Humes, and Joseph Lawlor, at SWRL Edu- 
cational Research & Development** Their approach is 
also one that recognizes writing as a process. Their 
developmental efforts nave been concentrated on four 
specific elements of writing instruction: sentence 
combining, generating content for a particular dis- 
course type, organizing content, and revising. 

RSVP x 

Still another approach to assisting students in 
the rewriting and editing process is the very sophisti- 
cated RSVP (Response System with Variable Prescrip- 
tions), developed under the direction of Kama la Anandam 
at Miami-Dade Community College in Florida. 

The best way to understand how RSVP is used is to 
assume that you have just collected 75 essays from 
three of your classes. First, you must read the essays 
holistically in order to place them in one of four lev- 
els, A, B, C, or D. These levels correspond to levels 



*See p. 75 for a description of SWRL's project. 
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of writing skill: primary, basic, intermediate! and 
advanced* The next step is to read the essays analyt- 
ically and identify those specific errors you wish to 
call to the attention of the student. At this point, 
you may Inc lude any written comments you deem appro- 
priate on individual papers* 

Once the readings are completed, you indicate on a 
computer card the kind of feedback you wish the student 
to receive* The computer then generates a personal 
letter for each student, reflecting the items that you 
coded on the computer card* 

The feedback each student receives is written on a 
reading lev^l that corresponds to the student's writing 
sk i 1 1 level , wh ich was determined by the teacher in 
step one, i • e* , f if th grade ( pr imary) , seventh grade 
(basic), ninth grade (intermediate)^ or eleventh grade 
(advanced)* The feedback consists of written prescrip- 
tions that reinforce for the student what has been 
accomplished and provide instruction in how to avoid 
errors in future assignments* RSVP is capable of pro- 
viding feedback in a variety of skill areas, including 
spelling, subject-verb agreement, sentence structure, 
and organization* 

The system is also capable of generating individu- 
a 1 ized study /exerc ise ass ignments. These ass ignments 
are based on twelve major writing skill areas, which 
have been divided into over sixty subsk ills. Students 
are also given a selection of page references in spe- 
cific texts to use as resources. 

In add it ioh to these instruct ional capab i 1 i t ies, 
RSVP a lso has management capab i 1 i t ies. The program 
accumulates students 1 errors from assignment to assign- 
ment, prov ides a status report to teachers, and con- 
ta ins an opt ion to prov ide students with progress 
reports at times designated by tjie teacher. 

The Writer's Workbench 

Finally, I would like to describe to you what is 
perhaps the most advanced editing system in existence 
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today, The Writer's Workbench , a creation of Bell Labo- 
ratory scientists In New Jersey* After a writer enters 
a piece of text, the 32-program system* is able to cor- 
rect spelling, punctuation, and grammar. It will also 
analyze, sty le and provide feedback to the author on 
sentence length, cliches, wordiness, and jargon. 

The program literally suggests editorial changes' 
to the writer* Based on t rad I t lonal guides to writing 
effective prose, such as Strunk and White's The Ele- 
ments of Style , the system searches a text for sty 11 s- 
, tic breaches and suggests alternatives. For example, 
the program will detect split infinitives or forced 
expressions such as M the utilization or" and offer the 
writer specific alternatives for Improving the text/ 

Yet another unique feature of the Workbench Is Its 
prose comparison program. Stored In the computer's 
memory is a set of written passages that have been 
developed by the program's designers to reflect some, 
specific standard of effectiveness for certain kinds of 
expository prose, for the most part, articles written 
by scientists. Some points of comparison used are 
readability level, average sentence length, sentence 
types, and passive verb phrases. After the computer 
compares an original text to one of its benchmark 
selections, it produces a count of each point of com- 
parison along with a suggestion. For example, a writer 
might receive the following kind of report: 

» 

1, Readability (years of education necessary to . 
, read your text) : 13.2 

2. Average sentence length: 32. k words 

3* Sentence types: simple, 13 percent; complex, 
J»7 percent. Yoijr text contains more complex 
sentences than Is usual for this kind of 
writing. You could improve your writing by 
reducing the number of complex sentences. 

Passive verb phrases: tO percent 

Obviously, there are some reat\ f imi ta t fons to this 
approach to editing. The Workbenc h system reminds me 
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rf a brief program I wrote with my dissertation advisor 
many years ago. I was talcing a criticism course at the 
time and was eager to impress my professor with the 
computer 's abi 1 i ty to analyze prose style. In a few 
» . short hours I had written a very simple counting pro- 
gram to^which we submitted, two passages — one from The 
Sound and The Fury , .by Faulkner, the other from A Fare- 
well to Arms , by Hemingway. The program was flawless 
in its ability^ to count words and sentence length. It 
was less than spectacular 'in the advice it gave to each 
author for waiting more effective prose. Faulkner was 
asked to take lessons from Hemingway. And Hemingway, 
' in turn, was asked to take lessons from Faulkner. 

„ Whatever its shortcomings, though, The Writer's 
Workbench does represent the state of the art in pro- 
viding editorial assistance for specific kinds of 
prose. 

CONCLUSION 

Computer-assisted composit ion instruction is still 
very new to most teachers of writing. The success of 
any new innovation in education depends on how well it 
is accepted by classroom teachers. 1 think that accep- 
tance will largely depend on three things: (1) how 
creative we are in solving the problems related to num- 
bers of students and time allotted for writing in the 
curriculum; (2) how successful teacher educators are in 
training teachers of writing to approach writing as a 
process; and (3) how convincing program developers are 
in demonstrating that computer-assisted instruction is, 
indeed, the state of the art in the teaching of 
wr it ing. 
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COMPUTER-ASSISTED 
PRE WRITING ACTIVITIES: 
HARMONICS FOR INVENTION 



Hugh Boras 

United Stfttes Air Force Academy 



I expect to be teaching composition until at least 
201 1. Therefore, I expect to hear the question "What 
should I write about?" a few more tm*s. Specifically, 
at 140 students for twenty-nine years at eight essays 
apiece— that's 32,480 times. Think of the challenge 
I'il- have coming up with 32,480 difftreqt topics. I'm 
not prepared for that, but I do th'nk the analytical 
engine that has crept Into our humanities garden can 
help me. In fact, I cannot imagine u?/ 3:^0, Tuesday 
composition course * k . 2 spring of 200f without com- 
puter terminals sor. * «*ra, maybe everywhere. I'll use 
computers to train teachers. I'll consult and advise 
student writers and some professional writers on disks. 
I'll .accept software as I accept research papers today. 
Yes, the electronic revolution is here. 

Now the most vital part of my work and my day- 
dreaming Is In envisioning and promoting the computer 
as a writer's tool, a tool to help writers discover, 
arrange, and style Ideas. The research I've been most 
involved In thus far has to do with stimulating rhetor- 
ical Invention in composition using computer programs 
that ask questions and motivate a systematic Inquiry. 
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Mot only have such programs modified my own writing, 
but I'm learning to think about the geometry of Inven- 
tion In new ways. Some writers Invent . In solos, others 
in duets, and some In orchestration. 

INVENTION AS SOLO 

Our students have voices. They have experience. 
What many of them don't have is the strategy or the 
confidence to amplify the voice or articulate the expe-" 
rlence, so learning to Inquire Into their own experi- 
ence challenges them. That elusive search for self- 
confidence short of wisdom often Is the most difficult 
step In the writing process. We listen to our stu- 
dents 1 solos, wishing, they had more time to practice. 
Invention Is a solo--fIrst a solo based on knowledge 
and experience. 

But this solo uses Invention techniques: Some we 
can describe and some we cannot. Those we can describe 
are often called heuristics, heuristics being strate- 
gies for discovering Ideas or solutions. If the Imag- 
ination Is dark, an Invention strategy Is a way of 
flooding the stage with light and filling the auditor- 
ium with sound. The creative enterprise of stimulating 
the process of Inquiry will challenge the s'tudent, 
whatever the curriculum—anthropology or computer sci- 
ence, English literature or organic chemistry. { don 1 * 
envision a classroom without teachers, but I will not, 
cannot, must not "teach 11 the discoveries of prewrlting. 
The prewrlter' is wrapped up In the undiscovered self, 
and the responsibility for solving the Invention puzzle 
Is ultimately each student's. But others can stimulate 
the process? others can make Invention more of a duet. 

INVENTION AS DUET 

Needless to say, the life of the mind, too, can be 
a duet of language and thoughts, thoughts and language. 
However, the duet Mm speaking of Is the duet with 
teacher and student. A teacher can direct students 
attention and experience to, the topic In a number of 
ways. And humanistic teachers can do that without 
knowing what students know about a topic, without car- 
ing as much as students care about a topic, and without 
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actually partak'ing. la the discoveries students % wi 1 1 
make about a topic. 

■ Say I have a student who is the world's chief 
authority on* indolebutyr lc acid, a plant hormone espe- 
cially good for root development. As a teacher, I can 
ask him or her questions that will he'lp stimulate 
thinking about that acid. For example: 
t 

Who discovered the acid? When? 

Was the process In any wry accident»1.7 

How does that acid change? 

What special experience made you select in- 
dolebutyr Ic acid as your topic? ♦ 

* f 
* - How is that acid created? 

What systems benef inmost from this aclcfr?^ 

What implications does this acid have.polit- 
ically? Economically? Culturally? 

What is the opposite of this acid? 

How is this acid like an accomplice? 

Like a- ruby_-throated hummingbird? 

Like a hearth? / 

What will you claim at the end of your essay 
about indolebutyr ic acid? 

The suggest i ve power of such quest ions doesn 1 1 
depend on the content or the topic but rather on the 
interrogat ive propositions themselves. The student 
must haVe the content. The student must be the person 
who has prepared, who lias incubated, who has a felt 
" need for the insight, and whose own curiosity .will 
finally evaluate the quality of the findings. 
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<* ' • 
Consequently, a teacher may ask these questions 
without fear of pretending to,know the answers (though 
some of us probably couldn't resist the temptation to 
explore sonfe of the more Intriguing issues, -say the 
analogy to the hearth, suggesting that the temperature 
variations caused by thcacld could possibly change the 
developmental cycle of a root system 4 for the better). 
Inquiry tempts us; inquiry should tempt us u Questions^ 
tempt most of us to answer; that, as a matter* of fact, 
is a question's proposal 1 1 onal value. 

The difficulty, with invention as duet is that a 
composition teacher' s; voice cannot, >practiqaMy speak- 
ing, Jast that long. Our enrollments are too high? pur 
time Is not our own. It would be Impossible to talk to 
all of our student writers in order to spur their cre- 
ative processes. Consequently, If we wish to engage 
them In the prewriting process,* we need help. That's 
where the computer entered for me. in January, 1977, 
in the mMst of my doctoral research, i began to think 
about rhetorical invention as an electronic orchestra. 

INVENTION AS ELECTRONIC ORCHESTRATION 

I have designed, developed, and programmed three- 
computer programs to encourage thinking, programs I 
cal;l Vartiflcial Intuition." These programs ask writ- 
/ ers questions based on particular systems of inquiry, 
specific heuristics— though at some pdlnt I hope stu- 
dents will say to themselves, "Wait a niinute, I can ask 
mysel f such questions." The programs imi tate three 
popular heuristics, specifically* Aristotle's topics, 
Kenneth Burke's dramatistic pentad, and the tagmemlc 
matrix developed by Richard Young, Alton Becker, and 
Kenneth Pike. 

The strength of these programs is tijat they imi- 
tate a way to investigate a topic, not the Way by any 
stretch of the imagination, just one. way. Prewriting, 
moreover, has certain subroutines that a computer pro- 
gram can Imitate rather well. What are they? 

1. A program can ask the question. 



2. A program can clarify the question. 
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3* Good software can define the dimensions 
of the question. 

4. The software can call attention to the 
* essay's purpose* 

5. I,t can purposefully distract (for incuba- 
tion's sake). • 

6. it can rephrase the question. 

7* It can create random metaphors. 

8. invention programs can offer research 
suggestions. , ■ » 

9* A program can print a copy of the dia- 
logue so a student can later evaluate the 
answers. 

After a prewrl ter uses such rout Ines, then . the 
teacher can Jump in more efficiently as an Inquiry 
diagnostician and tell students what cognitive styles 
they have already used, suggesting others that may help 
them develop more Ideas. Such conversations then be- 
i come the motfvation for furthering the inquiry. 

Now you need to see an example. In the following 
computer-prompted dialogue between a senior enrolled in 
pur literature seminar and the Aristotle T0P0I program, 
Peggy explores Thomas Pynchon's The Crying of Lot k3 
and his symbolic use of the entropy concept. We join 
her afte^ a few introductory remarks — directions and 
such. Peggy's remarks are underlined. 



NOW i NEED TO FIND OUT WHAT YOU ARE 
WRITING ABOUT. SO WOULD YOU PLEASE TYPE IN 
Y0\JR SUBJECT. t AM LOOKING FOR ONE TO THREE 
, WORDS. 

ENTROPY IN MAXWELL'S DEMON 

HOLY ELECTRONICS! THAT'S WEIRD, X USED TO 
DATE A COMPUTER INTERESTED IN ENTROPY IN 




MAXWELL'S DEMON 
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A COMMENT ABOUT PURPOSE 

DURING THJS EXPLORATION PROCESS, YOU 
WILL BE ASKED TO CLARIFY* THE PURPOSE OF YOUR 

PAPER ON ENTROPY IN MAXWELL'S DEMON. 

* * 

SO NOW WOULD YOU BRIEFLY DESCRIBE WHAT, 
THE PURPOSE OF YOUR PAPER IS BY COMPLETING 
THIS STATEMENT: THE PURPOSE OF THIS PAPER - : S 
TO . . . (LIMIT: ONE LINE) 

DESCRIBE r HOW THE -ENERGY THAT' IS PUT INTO THE 
"DEMON 11 VIA THE "SENSITIVE" IS TRANSLATED. , . 

ANY MORE? b * v 

». 

IF SO, TYPE WHATEVER IT IS. IF NOT, 
TYPE NO. 

AND THEN LATER PUT TO USE AS EN F t " Of OUTSIDE 
THE CLOSED SYSTEM. 

FINE, PEGGY, YOU AND I WILL "i ALK AGAIN 
ABOUT YOUR PURPOSE. 

RELAX NOW, PEGGY, AND ENJOY THIS BRAIN- 
STORMING SESSION. 

WHAT HAS- BEEN DECIDED ABOUT ENTROPY IN 
MAXWELL'S DEMON TO DATE? 

EX PLAIN I 

DECISIONS HAVE BEEN MADE ABOUT ENTROPY IN 
MAXWELL'S DEMON. 

WHAT WERE THEY ABOUT? WHO MADE THEM? 

FOR EXAMPLE, IF I WERE WRITING A PAPER ABOUT 
INFLATION, I WOULD WANT TO WRITE A PARAGRAPH 
OR TWO ABOUT THE GOVERNMENT'S LEGISLATION TO 
DATE. 

TRY ANSWERING THIS QUESTION NOW. 

O - 24 
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ENERGY IS PUT INTO THE "DEMON" VIAjTHE "SEN- 
SITIVE." NEXT THE DEMON WOULD TRANSLATE THE 
"COMMUNICATION" AND SEPARATE IT INTO DIFFER- 
ENT ENERGY FORMS. ~ 

GOOD, PEGGY, ADD TO YOUR RESPONSE NOW. 
CO NTINUE!' 

(IF YOU DON'T UNDERSTAND, JUST SAY SO NEXT 
TIME. I'LL HELP.) 

WE'RE MOVING RIGHT ALONG. HERE IS QUESTION 2. 

WHAT ARE THE GOOD CONSEQUENCES OF ENTROPY IN 
MAXWELL'S DEMON? 

IT CAN CREATE ENERGY IN A CLOSED SYSTEM 
(WHICH DEFIES THE 2ND LAW OF SS 

. GO ON, PEGGY. 

THERMODYNAMICS). 

FINE, PEGGY. WRITE SOME MORE. 

THIS ','DEMON" CAN BE COMPARED (ON A VERY BROAD 
LEVEL) TO THE DEVIL IN ... THE WORLD TODAY. 
TH E DEVIL TAKES THE ENERGY COMMUNICATED TO IT 
. . . (BY PORNOGRAPHY. OR SIN FOR EXAMPLE) 
A MD USES IT TO CREATE (CHANNEL) IT TO OTHER 
USES - TO WIDEN HIS CONTROL OF THE WO RLD. 

OUTSTANDING, PEGGY I 

ANYTHING ELSE? 

(YOU^CAN ADD MORE INFO, ASK A QUESTION, 
OR GIVE A COMMAND-WHATEVER YOU WISH.) 

> 

CONTINUE1 
OKAY. 
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^ YOU WISH TO NARROW OR CHANGE YOUR 
SUBJECT? 

j (MAYBE REVISE THE WAY IT SOUNDS IN THESE 
QUESTIONS?) 

~ NO. 

************** 



WHAT OBJECTS DO YOU ASSOCIATE WITH ENTROPY IN 
MAXWELL'S DEMON? HOW MIGHT THEY BE INCLUDED 
IN YOUR THEME? 

EXPLAIN I * 

IF I SAY "BLACK, " YOU SAY "WHITE." 

IF I SAY "HEADACHE," YOU SAY "ASPIRIN." 

NOW PEGGY,- IF I SAY ENTROPY IN MAXWELL'S 
DEMON. WHAT DO YOU SAY? 

WHAT ARE YOU THINKING NOW? 

THE IMAGE OF THE PERPETUAL MOTION MACHINE 
' COMES TO MIND-MAKING SOMETHING OUT OF 
NOTHING. 

BY GEORGE, PEGGY, GOOD ONE. WRITE A 
LITTLE MORE PLEASE. 

6 

ARRRRGGGGG 

FANTASTIC. ANYTHING ELSE? 
HELP! 
' OKAY. 

************** 
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•WHAT IS THE MOST LIKELY PLACE FOR ENTROPY IN 
MAXWELL'S DEMON TO EXIST? . 

WHAT DO YOU MEAN? 

WHERE SHOULD ! GO TO SEE ENTROPY IN MAXWELL'S 
DEMON7 ' CAN I GO INS IDE 7 CAN I GO OUTS IDE 7 
WHY OR WHY NOT7 

YOUR TURN, PEGGY. 
OH MAN 

AHHIiH, SHORT AND SWEET. NOW TELL ME 

WHY? 

IN OTHER WORDS, ELABORATE A LITTLE. 

I GUESS THAT THIS REALLY DOES BROADEN THE 
WHOLE QUESTION. THE WHOLE . . . BASIS FOR 
T HE ABILITY FOR THE DEMON TO WORK WOULD LIE 
IN THE PERSON ... WHO WOULD BE TRYING TO 
"COMMUNICATE" TO THE DEMON. THIS WOULD . . . 
T HEREFORE MEAN THAT WHOEVER WAS THE "SENSI- 
TIV E" WOULD ALREADY, TO AN EXTENT. BE UNDER 
THE DEVIL'S CONTROL. NOW I'M REALLY CON- 
FUSED. - 

************** 



, STOP I 

YOU EXPLORED k QUESTIONS OUT OF THE 11 
I ASKED. THAT'S 36.3636 PERCENT. LET ME 
REMIND YOU THAT YOU ARE STILL IN THE FIRST 
'STAGES OF THE CREATIVE PROCESS. THESE IDEAS 
MUST SIMMER NOW. ALSO, i HOPE YOU CAN CREATE 
SOME OF Y °UR OWN 'TOPIC" QUESTIONS. I WON'T 
ALWAYS BE AROUND TO HELP. > 

HOPE YOUR PAPER IS TERR I F I C 1 
GOOD BYE & GOOD LUCK! 

© ■ 27"' , 
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Now Mil grant that Peggy 1 s answers reflect a cer- 
* in caring about her subject. She wasn't putting in 
/srbage," and she mentioned afterwards that she wished 
she had known more about the topic before she started 
the inquiry. NevertheJess, her computer-assisted diar 
logue lasted about forty minutes, and when she left the 
lab, she took twenty-one pages of printout. She had 
responded, and although she may not have f ul ly 0 compre- 
hended it, she was now incubating — the classic second 
stage of the creative process. The orchestra was 
tuning up. 

SOME FINAL HARMONICS 

As for the research findings, Mil only mention 
two items.* First, one of the major dilemmas: the 
problem of "rhetorical overload." In the experiments 
using these programs, students had more Ideas about 
their topics, for all of the quantMlve gains were sig- 
nificant over a control group. But when these same 
students were asked to organize their ideas Into some 
"arrangement," their arrangements were not signifi- 
cantly better than the control group's arrangements.' 
Arrangement, for these students, did not develop natu- 
rally from lots of Ideas. In fact, too many Ideas made 
the arranging task more difficult and more t?me- ' 
consuming. Second, we also verified that invention 
doesn't end. Several students told us on the follow-up 
questionnaire that the best answers to the questions 
did not occur to them while they were on-line. They 
were stimulated to think about their subjects from new 
points of view. That's exciting. 

The future of computer-ass I s ted Instruct Ion, for 
me, depends on how wel 1 we can "open" the programs. 
The computer can be used creatively and suggestively In 
the Invention process. And our work continues. These 
days, Mm designing composition programs using graphic 
analogies, for right- and left-brain connections are 



*A summary of the di ssertat ion research can be 
found in "Stimulating Invention In English Composition 
Throygh Computer-Assisted instruction," Educational 
Te chnology , August, 1980, pp. 5-10. 
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worth investigating. Also, Mm trying to define the 
explicit link between invention and arrangement; Pm 
hot as clear or as naive about that relationship as I 
once was. And what we'll be able to do with word pro- 
cessors in a composition setting will soon overwhelm 
us. As for the rest of the time? I daydream about the 
future. 

So the year 2011 arrived. Somehow, I didn't think it would ever 
come. So here I am reading my last college theme. I'm so glad my 
students haven 7 asked me what to write about since 1997; if anything, 
they have learned to "look" inside themselves for their topics, to deal 
with their topics as curious inquirers. Look at this topic. Who would 
have ever thought that some sophomorejvouid write an essay on "In- 
dolebutyrif 'Acid as Entropy" of all things. I wonder where she came 
up with that idea? 
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COMPUTERS AND THE 
COMPOSING PROCESS: AN 
EXAMINATION OF 
COMPUTER-WRITER 
INTERACTION 



Eftri Woodruff* 
The Ontario Institute for Studies in Education 



Suppose you are asked to help a school child write 
a short composition. There are a number of different 
helping roles you could assume. One approach would be 
to act as a consultant, sitting quietly and only giving 
information or opinions upon request. At the other 
extreme you could actively suggest content and lan- 
guage, leaving the child with little more to do than 
select from your offerings. In between these extremes, 
you could avoid direct suggestions of what to write but 
try to help the child by asking questions. However, 
there is a range of possible questioning roles-r-from 
asking very leading questions of the "Don't you think 
# . .?'» variety to asking more open questions that 
leave most of the thinking to the child. Deciding on 
what kind of helping role to assume depends on at least 
two considerations: First, what is yoiir objective— to 

*With MaTlene Scardamal ia (York University) and 
Carl Bereiter (The Ontario Institute for Studies in 
Education). 
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help the child produce a good composition in the ^hort 
run or to help the child lea/h? Second, which ofr the 
possible roles does your ^own knowledge and' abi \fc£y~ 
equip you to handle? Although on principle you migtft 
favor the role of asking open questions, it might prpve,^ 
difficult to ask educationally .productive questions 
unless you had an unusually deep understanding of the 
composing process. ; 

In designing ways for a computer to help children 
write, we have to ask the same two questions in order 
to determine a reasonable and productive role for 'the 
computer. As to objectives, most current uses of 
computers as word processors are aimed at helping the 
child produce a good composition in the immediate 
instance and only indirectly with helping the student 
learn. The programs ! shall discuss, on the other 
hand, were aimed at interacting with students in Ways 
to produce learning and only secondarily in ways that 
might lead immediately to a better composition. ! 

I 

The poss ib le roles for a computer are, however, 
severely limited by the computer's capabilities and by 
the extent of knowledge of the Composing process that 
can be applied to program desigrt. The first program 
that we of the York/0 !SE Writing Research project pro- 
duced was one that took advantage of a consultative, 
format, by offering a "menu 11 of help selections. The' 
second program we wrote used a questioning format. 
This program tried to lead the students to consider 
relevant questions as the composition developed. 
Finally, the third program we wrote assumed a collab- 
orative role. The student had a set of responsibili- 
t ies and so did the computer. Each of the three 
programs attempted to boost the students to a more 
analytic and comprehensive view of their texts. 

ftlE COMPUTER AS CONSULTANT: CAC-1 

Our in it ia I program, CAC-1 (Computer-Ass is ted 
Compos it ion) , tried to assist students, not by taking 
over parts of the task, nor by specifying what to do 
and when to do it, but rather by helping students use 
knowledge they had, but. were failing to use because of 
cognitive ^overload. This form of assistance, called 
i 32 
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•procedural facilitation, grew out of our investigations 
of the cognitive processes underlying cornposmg. Such 
facilitation has been shown to be an effective means of 
assisting the composing process (see Bereiter and 
Scardamalia, 1982) . 

CAC-1 was an attempt to reduce the mental burden 
that students are under while composing, by integrating 
various types of help with a t^xt collector and a stor- 
age routine. The program displayed a menu of available 
types of help whenever the 'help' key was pressed. One 
of the types of help, for example was a de 1 meat .on of 
the genre elements a student could i,v-.lude. The 
gram was tailored specifically to the opinio,, essay 
qenre, and so the elements were things like staten.snt 
of belief, reason, and example. Having selected one o. 
these, the student would then receive further help in 
the form of an explanation of the element and suggested 
sentence openers such as "One reason is . . . or Some 
people think . . •" to introduce the element. 

Specifically, CAC-1 acted as a text editor until 
the help key was pressed, and when it was, the program 
would ask, "May I help you?" If the student answered 
yes , CAC-1 could assist in the ways described below. 

1, f»1 I nning an argument p^Dan . If this form 
of help was requested, the computer would 
indicate that the following list of ele- 
ments could be included: a statement of 
belief, explanation of the belief, rea- 
sons for the belief, opposing beliefs and 
refutations, more reasons and examples 
for one's belief, and finally one or two 
summary statements. When the student 
indicated the element he or she would 
like to include, the program presented an 
elaborated explanation of the selected 
element with one or two sentence openers 
' appended (see Figure 1 for an example of 
this elaboration). 
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Figure 1 

An Elaboration, by CAC-1, of a Structural 
Element as Shown to the Student 

0 

REASON FOR BELIEF 



In .this section of the paper you tell the reader why 
you believe what you say. 

These sentences usually have the word because in them. 

/ 

After you tell why you believe what you say, it is 
always a good idea to give an example . 

You can start your sentence with: 

One reason 

or, 

/ 

I believe this because / 



PRESS C TO CONTINUE 



Help in producing the next sentence. 
This algorithm would search the sjtudent's 
last sentence for selected keywords and, 
upon finding one, would prompt the- stu- 
dent to say more .about it. For example, 
if the student had used the word "be- 
lieve 11 in the sentence before she or he 
asked for this help, the computer would 
respond; ■'Let's say more about your 
belief so the reader will understand." 

Help in chanqinq^words ^ # When students 
asked for this help, the* program would 
print out . their texts while numbering 

34 
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each of the words. Once the point of ^ 
revision was identified by number, the 
students could enter or delete the 
appropriate word, or a section of text 
could be inserted. 

1». Help in checking unsure words . This 
routine lowered the constraints of text 
production by using the '#' key to flag 
words the student was unsure of as to 
spelling or meaning. Whenever a student 
was in doubt about the spelling, meaning, 
or appropriateness of a particular word, 
he or she was instructed to type in a 
guess and end the word by typing the 
number-sign key. This routine then de- 
layed the correction of such words until 
the text was completely entered, or until 
the student chose to correct them. 

Experimentation with the above program, on grade 
six students, revealed mixed results (Woodruff, 
Shelter, . Scardamalia, 1981-82). Wh He the students 
used, enjoyed, and praised the program's beneficial 
effects, the overall quality of the r papers was not 
improved. An apparent weakness of AC- . j > that it Is 
too easily assimilated to a low-level What next? 
strategy of composition Bereiter S Scardamalla, 19J2). 
Thlf strategy!* an overly simple, forward-look ng 
approach to writing that fails to give attention to he 
whole text. Consequently, whi le the child ren found the 
program helpful in triggering ideas for what to say 
next, it did not seem to have engaged students in a 
higher-level consideration of composition choices. 
Although more experience and improved typing ski 1 
would likely have increased the program's beneficial 
Effects so might a program that takes, a more active 
r"e in directing the' students' attention between the 
higher and lower levels of the composing process. 

THE COMPUTER AS QUESTIONER: CAC-2 

' Our second program, CAC-2, attempted to intervene 
rnore directly in the students' composing process, wi th 
Th» Intention of leading students away from their char- 
y^acter istic "What nextr strategy.^ Instead of waiting 
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for the student to call for help, CAC-2 intervened at 
the end of every sentence. In point of fact, students 
using the earlier program, CAC-1, typically asked for 
help at the end of each sentence. CAC-2 intervened 
without being asked. It guided the student through a 
quest ion-and-answer sequence of variable length. The 
intent was to block use of the "What next?" strategy by 
getting the student to consider higher-level questions 
having to do v/ith type of content, warrant for asser- 
tions, and possible reader reactions. 

CAC-2 intervened with ^ question every time a sen- 
tence , terminator was detected. The program contained 
26 questions arranged in a branching sequence that 
depended on the answer to a preceding question. For 
instance, if the student responded yes to the question, 
n Do you have a reason for your opinion?" the computer 
would respond, "Okay, let's tell ,that to the reader." 
Upon detecting the next sentence terminator, the 
program would then display the question, "Have you made 
your reason clear to the reader?" The student could 
answer each question yes or no, or could press a key 
instructing the proaram to move on to the next question 
or to hold the question until another sentence was 
completed. The overal 1 intent of the quest ion ing 
procedure was to lead children to compose more care- 
fully considered and more fully .developed, opinion 
essays by switching their attention back and forth 
between the high and low levels of the process. In 
short, the program tried to induce the student to con- 
sider many of the issues that mature writers consider, 
but that are not taken into^ account by users of the 
"What next?" strategy. 

An example of the computer-writer interaction may 
clarify CAC-2's questioning routine. Suppose a student 
is asked to write approximately a page on the topic, 
"Should students be allowed to choose the subjects they 
study in school?" As soon as the student has signed on 
to the computer, the program asks, "Do you have an 
opinion on this topic?" (If the student answers no 
here, the program encourages the student to consider 
the question and formulate an opinion.) When the stu- 
dent answers yes , the computer responds, "Okay, let's 
tell your opinion to the reader," and the student is 
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allowed to enter a sentence. At the termination of the 
student's sentence, the program halts the text collec- 
tion and asks, "Would you always believe this no matter 
what happened? 11 in an attempt to get the student to 
clarify and elaborate the opinion statement. If the 
student answers yes, CAC-2 continues by asking, M Do you 
have a reason for your opinion?' 1 The program becomes 
quite stubborn at this point. When the student does 
not have a reason , CAC-2 indicates that the student 
must have a reason to continue, and waits for him or 
hereto develop one. Orice the student indicates that 
she or he has a reason, CAC-2 encourages the student to 
include it. The program continues- in this manner, 
leading the student through questions designed to en- 
courage clarification of 1 the reason, evidence and 
support for the reason and opinion, inclusion of more 
reasons, and, finally, a summarization^ the paper. 

Since there was no way of guaranteeing that the 
question branching routine would accurately direct the 
students, the interaction could not remain entirely 
compulsory. If, for example, the student included both 
an opinion and a reason in the first sentence, then the 
question, "Do you have a reason for your opinion? 11 is 
inappropriate. In this case, or in the case where stu- 
dents simply did not understand the question, they were 
encouraged to press the 'continue 1 key, and the program 
would then sk.ip to the next question, assuming that the 
previous question had been answered favorably. At 
other times, the student cou Id press the 'hold ' key, 
-which returned the control of the keyboard to the stu- 
dent and allwed another sentence to be included before 
the question that was on hold would be resubmitted. 
This option, of course, allowed students, to wrije_as_ 
many sentences address <ng the preceding question as 
they wished. 

In an attempt to investigate the effects that 
CAC-2 had on students' writing, we tested the program 
with 36 eighth-grade students. The study involved 
writing in three conditions, and the results, in terms 
of tjie rated quality of the essays, varied depending on 
the order in which the conditions were presented 
(Woodruff, Bereiter, S Scirdamal ia, 1981-82). The 
'irst condition had students produce a paper-and-penc i 1 
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baseline essay. On a following day, half the students 
composed another essay using a version of the C^C-2 
program that did not ask any questions, while the other 
half used CAC-2 as it is described above. On the third 
day, the students were slotted into the opposite con- 
dition so that the study was counterbalanced. Students 
who produced .compositions in the order basel ine , no- 
quest ioning , and questioning obtained approximately the 
same ratings under all three conditions. On the other 
hand, students who produced compositions in the order 
basel ine , questioning , and no-questioning , obtained 
significantly lower ratings in the questioning condi- 
tion. This find ng suggested that the students were 
overloaded if thty had to deal with the novelty of a 
computer keyboard and a questioning routine at, the same 
time, but that this handicap was largely overcome by a 
single session of (keyboard composing. 

Subsequent analysis revealed that the arguments 
produced in the computer questioning condition were 
Jess well thought out, more one-sided, and less mature. 
A similar decline in performance was observed by Black 
and Wilkes-Gibbs (1982) with writers who were asked to 
plan aloud as compared to composing in silence. Appar- 
ently any such additional task demand diverts mental 
capacity from the main task and results in writing that 
appears simpler or less mature. Thus, while the imme- 
diate effects are .clearly negative, the long-term 
.effects remain to* be tested. Presumably, with prac- 
tice, the disruptive effects of the novel * procedure 
would disappear; indeed, our results suggest that these 
effects largely disappeared after just one sess ion. 
However, educational benefits from the kinds of ques- 
tioning used in CAC-2 would not be expected until after 
extended use. For it is not the. effects of questioning 
on the immediate compos it ion that we are concerned 
with, but rather the change in basic composing strategy 
that would occur if students became accustomed to con- 
sidering such questions in the normal course of writ- 
ing. 

Although no long-term testing of GAC-2 has yet 
been attempted, the response of students to the short- 
term trial suggests that long-term use is at least 
feasible. Students themselves rated the compositions 
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they pf-oduced with CAC-2 as superior to those produced 
under the other conditions. In . follow-up interviews, 
students also reported that they preferred CAC-2 to 
normal writing and that they found the questions made 
writing easier for tham. ' Finally—and most encour- 
agingly—most of the students reported that they never 
thought about the kinds of questions CAC-2 Had led them 
to consider, but that they intended to consider such 
questions in future writing. v We can be sure that it 
would take jnore than one trial for the questions to 
become internalized, but the intention speaks well for 
the likelihood that the questions would become inter- 
nalized in the long run. 

THE COMPir* mLR AS COLLABORATOR: EXPLORE 
* <% 
I have descr ibed one program that represents a 
consultative form of interaction and another that rep- 
resents a more directive form of interaction. Our 
third program, EXPLORE, represents a collaborative form 
of interaction by sharing the composing task with the 
student. This program assumes the responsibility of 
producing the content and linguistic form of the indi- 
vidual sentences, while the student has the responsi- 
bility for the structure and style of the paper. 
Students are shown a variety of sentences that vary 
according to their structural function and stylistic 
form. The student's job is to create a text by eval- 
uating, and then selecting or rejecting the presented 
sentences. EXPLORE has a data base of 308 sentences on 
the issue of whether or not T.V. is a good influence on 
young people. Half the sentences (15*0 are on the pro 
side of the topic%nd the ether half are on the con 
side. -.Each set of the 15*» sentences is further divided 
into cells representing structural elements of an opin- 
ion essay— statement of belief, reasons, elaboration 
and examples, and conclusion. Each cell contains seven 
sentences, each of which conforms to a particular 
style: ordinary (called OK), weak, exaggerated, unbe- 
lievable, unclear, wordy, or jazzy. 

Once the student has signed on to, EXPLORE, the 
computer asks whether the student would like to 1) 
start a new essay, 2) add to an old essay, 3) change 
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the essay, k) type the essay, or 5) read over the es- 
say. When the student indicates that he or she wants 
to start, a new essay, the computer asks the student to 
select either 1) a statement *of belief, 2) a reasoft, 3) 
an elaboration, k) an example, or 5) a concluding sen- 
tence. (The student also indicates whether she or he 
wants the pro or con side of the argument at this 
*>tep.) At thn^ point, EXPLORE retrieves a sentence 
from one of the^indicated cells and presents it to the 
student along .with a style evaluation list. (See 
Figure 2 for an^xample of EXPLORE at this stage.) 



Figure 2 

An Example Sentence and Lis! of Style 
Choices as Presented by EXPLORE 



Here is a possible sentence. What do you, think of it! 



T.V. is not exactly the" best influence on most young 
people. , 



1. Keep this sentence. 

2. It's too weak. 

3* It's %too exaggerated. 

k. It's unbelievable. 

5* It's unclear. 

6. It 's too wordy. 

7. It's too jazzy. 

8. I want to choose another sentence type. 
9* Read over essay. 



Type the number 7 



If the student indicates that he or she wants to 
keep the presented sentence, EXPLORE adds the sentence 
to the paper and branches back to the structural ele- 
ment selection routine. On the other hand, if the 
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student rejects the sentence as ,being toiKmuch of one 
style or another, the computer selects an Alternative 
sentence for presentation. This selection is dependent 
upon the student's evaluation of the previous sentence. 
For example, if the student evaluated the previous se>>^ 
.tence as too unbelievable, and indeed the sentence had X 
''been authored to be of that style, then EXPLORE pre- 
sents the OK or ordinary version. If the student eval- 
uates the previous sentence incorrectly, then the next 
presented sentence is selected to contrast the last 
evaluation. For instance, the student may call a sen- 
tence too weak, when in fact it was authored tp be the 
^ OK version, so the computer would select the exagger- 
ated versioft for presentation. The student continues 
in the above manner, selecting and rejecting sentences 
until she or he feels the essay is complete. 

EXPLORE's contrastive attribute was also included 
in its editing options under the "translate" function. 
EXPLORE's editor allows the student to 1) change the 
order of the selected sentences, 2) delete sentences, 
3) read the sentences with reference numbers, h) trans- 
late a stored essay into a requested style, and 5) 
restore a stored essay to its original version (i.e., 
return the essay to the state it was in when the stu- 
dent entered the editor). The translate function is 
quite unique in that it allows the student to take a 
previously produced essay and translate it into any one 
of the seven different styles. This option allows the 
student to see, with oase, the rhetorical effects of 
style while the structure and content of the paper are 
held constant. (See Figure 3 for two examples of this 
function. ) 

EXPLORE is designed to ease the mental burden of 
composing. Since the computer is producing the content, 
and linguistic form of the text, students are able to 
produce more essays per class than they would be able 
to under normal conditions. With this facility, stu- 
dents are allowed to concentrate on aspects of the 
composing task that are seldom made conscious. Fur- 
thermore, students are encouraged to experiment with 
novel forms of structure and to eva luate the re la t ive 
effects of style. And it is through such efforts that 
we expect the users to construct some of the higher, 
m« r e sophisticated, composing strategies. 
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Figure 3 

Three sample EXPLORE Texts Showing the 
Original and Translated Jazzy and Wordy 
Styles of the Original 

ORIGINAL 

1. T.V. is a bad Influence on young people. 

2. Too much violence Is shown on T.V. 

3. The overemphas is on death and bloodshed has made 
violence an almost acceptable way of life. 

4. Murder trials have recently taken place where the 
defendant pleaded T.V. addiction. 

5. For these reasons, it is clear that T«V. is a poor 
influence on young people. 

JAZZY 

1. T.V. is the real pits. 

2. Bang! Pow! Thud! Aaarijh! That's what T.V. is 
all about. 

3. People don't freak out about crime anymore, because 
they see so much of it on T.V. 

A. If you see somebody getting mugged on the street, 
you stay cool and say, "So what else is new?" 

5. 'So, now you can see that T.V. is the real pits, and 
you'd better believe it. 

WORDY 

1. Watching T.V. is definitely a bad influence on the 
young people of our modern world of today. 

2. Television is a bad influence on our people because 
it shows far too much violence that is not healthy 
for young people to watch. 

3. Because of people watching T.V. so much, they get 
used to what they see on T.V. and think it is nor- 
mal, which is violence. ' 

k. For instance, if you see a lot of robbery and 
\ shooting and kidnapping, etc., on T.V., then you 
\ start to think it >s normal to have robbery and 
Nshoot ing and kidnapping, etc. , in your own city 
where you 1 ive. 
5. lf\ou consider these facts and points, I am sure 
you vNll conclude that, as I said at the beginning, 
, T.V. iV. a bad influence on the young people today. 
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Exploratory tests of the program on grade 12 stu- 
dents found some evidence suggesting that students will 
experiment with the style of the sentences and the 
structure of the text, -This data, collected over eight 
successive classes, indicated that the distribution of 
sentence styles tended, in the EXPLORE essays, to be 
less weak, unclear, and exaggerated, but more wordy 
than students would normally write (Bereiter, Scarda- 
malia, £ Woodruff, 1982).' This experimentation sug- 
gested that" students were exercising skills they seldom 
have the, time to concentrate on. One of the findings, 
as evidenced by the students 1 post-experimental impres- 
sions of the program, was that students increased their 
awareness of text structure, Jhe interview data, col- 
lected from one of the classes involved in the study, 
indicated that over 30% of the students felt their 
experience with EXPLORE taught them something about the 
structure of a paragraph. A clear example of what most 
students felt they learned is extracted from one stu- 
dent's text and presented below: 

What i did learn, in fact, from the, program 
was how to visualize an essay as a set of 
individual points that need to be correctly 
arranged in a sensible order, like construc- 
ting a building. The bricks of a building 
need to be placed properly in order to form a 
solid foundation, this is also true for an 
essay. 

As a collaborative program, EXPLORE was a success. 
It did not try to move students through great leaps and 
bounds, but it did give them the opportunity to prac- 
tice some of the skills that would normally have been 
difficult to exercise. The degree of EXPLORED success 
is dependent upon the classroom teacher. The program 
is most successful when it is combined with challenging 
tasks. One such task is to give the students the goal 
of trying to make their papers sound as if they had 
been authored by someone else, such as an expert, some- 
one genuinely concerned, someone overly emotional about 
the subject, or a pompous windbag. Another task is to 
convince different types of audiences. Alternatively, 
the teacher may wish to see the students manipulate the 
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structure of the texts by giving them the goal of mak- 
ing one point, but making sit clear, or of trying to 
balance arguments on both sides of an issue. The num- 
ber of interesting tasks is limited only by the imagi- 
nation of the teacher, and the more interesting the 
tasks, the more successful EXPLORE is likely to be. 

CONCLUSION 

In discussing EXPLORE, CAC-1 , and CAC-2, I have 
presented three different modes of interacting as built 
into three different programs. The least intrusive 
program, C.AC-1 , simply acts as consultant. While this 
program has the 'advantage of helping to reduce the 
writer's mental burden, it has the disadvantage of 
being incorporated readily into a "What next?" com- 
posing strategy. CAC-2, on the other hand, can over- 
ride the "What next?" strategy, but it appears to do 
so, at least during initial use, by dividing subjects 
attention among more task features than they can handle 
as they compose. Finally our last program, EXPLORE , 
demonstrates one way of dividing up the composing pro- 
cess so that the student and computer can work collabo- 
ratively. This form of interaction appears to be best 
suited to situations where dividing the task affords 
the opportunity to develop mature strategies. EXPLORE 
concentrates only on selected aspects of the composing 
process, but it allows greater forms and amounts of 
exercise than can be experienced under normal condi- 
t ions. 

It seems clear that different forms of interaction 
influence different aspects of the composing process. 
In our current work, we are experimenting with a pro- 
gram that interacts with the student during planning 
rather than during writing a composition; yet another 
program we foresee is one that will provide procedural 
support to students as they evaluate, diagnose, and 
revise a previously written composition. As I noted at 
the beginning, the possible roles one may design for a 
computer are limited by the computer's capabilities and 
by our applicable knowledge of the composing process. 
But both of these areas are advancing rapidly. As com- 
puters become more sophisticated at interpreting lan- 
guage input and as we become more sophisticated in our 
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understanding of what goes on In the minds of students 
when they write, we can expect to see subsequent gen- 
erations of Interactive programs that help student 
writers In Increasingly educative ways. 
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Educators have a crucial role to play In today's 
rapidly expanding field of instructional software. It 
is our responsibility to become skilled evaluators who 
look critically at courseware before we purchase It for 
use in our classrooms. We must demand excellence and 
reject that which is mediocre. We must be willing to 
write critical reviews in our professional journals. 
Finally, we must persuade those journals that have not 
yet added computer courseware to their reviews of 
instructional materials to do so. 

The technology that can be used to set new stan- 
dards of courseware excellence now exists. Creative 
designers and programmers are developing courseware 
that taps the interactive power . of the computer and 
truly involves the student In the learning process. 
Merely placing workbook pages on the screen and asking 
occasional mul tiple-choice questions Is no longer 
enough. We are well past the stage of being pleased 
simply because a program will load and run correctly. 
As we locate highly creative, interactive programs, we 
must publicize them to our associates for their own use 
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and to the larger educational community as a new stan- 
dard for instructional computing* . 

* 

Approximately 4,000 programs are currently being 
advertised for sale in the education market. Probably 
less than 5% of the programs fall inta the category of 
good to excellent; some more conseryative estimates 
place this figure at less than ^%. it is our challenge 
to select courseware to meet our students' needs from 
among the relatively few good programs now available. 

THE EVALUATION PROCESS 

Prior to beginning a critical review of course- 
ware, it is helpful to select an evaluation instrument, 
guidelines, or other standardized criteria. The Guide- 
1 ines For Evaluating Computerized Instructional Mate- 
rials, published by the National Council of Teachers of 
Mathematics, is one of the most careful ly developed 
instruments. (See Heck et al., 1981, in Attachment A.) 
These guidelines are easy to read and have relatively 
simple forms. The guide is not geared only toward 
mathematics, so teachers in any subject area will find 
it useful. The MicroSIFT Evaluator's Guide For Micro- 
computer-Based Instructional Packages is more complex, 
requiring careful study before using the guide and a 
longer time to complete the forms. It is more appro- 
priate for an in-depth analysis of a courseware pack- 
age or for use by courseware developers or publishers. 
Each of these guides presents evaluation criteria and a 
thorough di scuss ion of the eva 1 uat ion process. Two 
shorter evaluation forms are also listed in Attach- 
ment A. (See Isaacson, 1979/1980, and The California 
Library Media Consortium, 1982.) 

The next step is to select and obtain courseware 
for .review. The journals listed in Attachment B all 
publish critical reviews that can be helpful in makinq 
initial selections. These critical reviews are not to 
be confused with the publishers 1 announcements that are 
often reprinted from advertisements without any evalua- 
tion of the actuol product. Critical reviews should be 
used as a buying guide only as a last resort; preview- 
ing the courseware should be part of the selection 
^process whenever possible. 
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Some courseware distributors offer a free 30-day 
return policy for materials ordered with an official 
purchase order or check. The primary advantage of 
ordering from such a distributor is that the courseware 
can be previewed in the classroom, where student reac- 
tions will frequently modify an instructor's original 
opinion of the material* Courseware not available from 
a di str ibutor can somet imes be previewed at confer- 
ences, software demonstrations, computer stores, dis- 
trict or regional centers, or at other schools* Some 
sales representatives will bring courseware to a school 
or district for preview. One innovative approach is 
the "software fair" or preview day to whicfi publishers, 
jobbers, and educators from a large region are invited 
for the specific purpose of previewing a wide variety 
of courseware. All of these alternatives should be 
thoroughly explored before any courseware is ordered 
from a catalog description, without the option of pre- 
view. 

After a courseware package has been obtained, 
there are three questions to be addressed before begin- 
ning a serious evaluation* In most cases a negative 
answer to any of the three may well eliminate the 
courseware from further consideration. 

1. Does the program run on my equipment? 

2. Does i t meet a curr icul urn need at my 
school ? 

3* Does it represent a valid use of the com- 
puter? 

These questions may appear too obvious to warrant dis- 
cussion, but they are all too often ignored. Course- 
ware is not transportable from one system to another 
and must match the exact configuration of equipment 
available at a specific site, including any required 
peripheral devices. Most courseware is selected to 
meet one or more stated curr icul urn object i ves and 
should be evaluated in terms of those objectives. Even 
an outstanding program may be of little value if it 
does not fit into the local curriculum. Finally, much 
of the courseware currently on the market appears to 
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make only a trivial use of the computer. If the pro- 
gram merely replicates some task that is already being 
done well with a textbook, workbook, or other tradi- 
tional medium, its purchase would seem to be a waste of 
courseware funds. 

EVALUATING THE PROGRAM 

Several teachers, students, and other staff mem- 
bers should become Involved in the evaluation. Course- 
ware is often used in more than one classroom and at 
several grade levels. Different teachers will empha- 
size different criteria. It is especially helpful for 
each teacher to use the package individually, prefer- 
ably in the classroom, and then to discuss it cr } t] ~ 
cally with other reviewers before making a purchase 
decision. The evaluation steps outlined below are 
designed for one teacher, but they can be repeated by 
each person involved in the review. 

K Be yourself * Read the documentation, payinp 
special attention to any stated or implied goals and 
objectives and to the instructions. When there is a 
management system as part of the courseware, try to 
assess how useful it might be and whether it will be 
easy to implement. 

2 # Be a "good" student . Go through the program 
in a positive manner. Follow instructions and try to 
do well. Ask the following questions: 

Can 1 follow the instructions and understand 
what 1 am supposed to do? 

Am i bored by the program or does it chal- 
lenge me to perform well? 

As a good student, -have I learned anything, 
developed new concepts, or felt that the pro- 
gram had any value for me? 

WasJt fun? Would I want to run it again or 
use it with a friend? 
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3* Be a "poor 11 student . Make a great many er- 
rors. Get confused and try to return to the instruc- 
tions for help. Miss the same problem/question several 
times in a row and see what happens. Then ask: 

How dp I feel about this program and about 
o the computer? A 

How do I feel about myself? Oid the program 
make , me feel dumb or did it help we to feel 
-successful ? 

Did the program help me when 1 made an error? 
Did it just say "try again" when I was 
already doing my best, or if I was guessing? 

When i made an error, did the program branch 
to easier materials, present items, more 
slowly, or explain the lesson in several dif- 
ferent ways to help me? 

Was there a beep or other noise that let the 
whole class know when I made an error? 

Did I learn anything? 

Would I ever want to use this program again? 

Be a "negative 11 student . Try to "crash" the 
program by pressing RETURN/ENTER unexpectedly. Ignore 
the instructions and press all of the wrong keys. Put 
in a number when the program asks for a letter. Be 
uncooperative. See how the program handles your antaq- 
on i sm : 



Could I crash the program? 

Did I get any insul t ing responses or did I 
get only a patient prompt that suggested what 
I should do until I decided that it really 
wasn't any fun to try to crash the program? 

Was it fun to fail? Did I get a more inter- 
esting graphic reward--the person was hanged, 
something exploded, the boat sank--when I 
gave the wrong answer? 
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Could I pun a lot of cra2y stuff on the 
screen or was the keyboard locked against 
unwanted responses? 

| Did I eventual ly* get m interested and become 
1 involved in the program almost in spite of 
; myself? ' 1 

r* 

I These questions will help to identify truly cre- 
ative and well designed courseware. Most programs deal 
fairly well with the good student, unless they are 
unfortunately boring. It is in responding to student 
errdrs, intentional or otherwise, that a program 
designer has the opportunity to show imagination and to 
use the power of the computer to present material in 
new and more helpful ways. 

, t 

Once you are familiar with the program, you will 
want to use it with your students, either individually, 
in small groups, or with the entire class. Students 
can be asked to complete some type of evaluation form 
or can be informally polled in discussions following 
the use of the program. Their reactions will provide 
additional insight into the potential value of the pro- 
gram being considered. Note especially whether most 
students complete the program without urging, want to 
repeat the program, or seem eager to share ft with 
their friends. Then complete the evaluation form you 
have selected. 

The final purchase/non-purchase decision should.be 
based upon the opinions of the teachers involved, the 
reactions of students, and the relevanc'fe of the program 
to the curriculum. High standards must be established, 
and our final decision should reflect our determination 
to select only the very best from among the many pro- 
grams avai lable. 

New courseware is appearing almost daily and itls 
quality is steadily improving. Any purchase should ye 
deferred until there is enthusiastic agreement among 
the reviewers that this is indeed a superior courseware 
package that is appropriate to the objectives of the 4 
school and truly represents an effective use of the 
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computer. We control the marketplace by our decision "* 
to purchase or not to purchase a specific program. It 
is our opportunity" today to encourage the development 
of creative and interactive programs by our refusal to 
purchase anything less. 
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ATTACHMENT A 
SOFTWARE EVALUATION: AN ANNOTATED BIBLIOGRAPHY 



AM, David H., $ Jane Berentson, n Sesame Place Style 
Manual, 11 The Comput i ng Teacher (September 1979) 
pp. 41-42. 

These 20 guidelines, used in developing software 
for Sesame Place, can also be used as a valuable 
checklist for evaluating instructional programs. 

The California Library Media Consortium for Classroom 
Evaluation of Microcomputer Courseware, "Checklist 
of Evaluative Criteria." Redwood City, Califor- 
nia, 1982. 

The Consortium developed this form with the goal 
of encouraging teachers to participate in the 
evaluation process by making the form as short and 
simple as possible. It is designed* to be pre- 
sented to teachers at a v/orkshop, and there is no 
written documentation. The form may be reproduced 
and modified to meet Incal needs. (Available from 
Ann Lathrop, San Mateo Cointy Office of Education, 
333 Main Street, Redwood City, CA 94063*) 

Coit, Lois, "Pick the Software that Helps Kids Learn," 
Executive Educator (March 1981) pp. 21-22, 37. 

Users are reminded that the place to begin soft- 
ware selection is with their own curriculum goals, 
deciding what the program is to accomplish. Users 
are then encouraged to preview the software, using 
* a checklist of eight technological and six educa- 
tional criteria. 

Corliss, Dennis, "Attributes of a 'Good' Instructional 
Program," The Computing Teacher (Fall 1979) p* 43* 

Concise description of twelve factors to look for 
in qual ity software. 
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Eldredge, Brupe, & Kenneth Delp, n How 
cational Computer Programs, 11 
(March 1981 ) pp. k 9 15. 

biscussion of computer-assisted instruction, com- 
puter-managed instruction, simulations, and edu- 
cat i ona 1 games . / 

Heck, William, Jerry Johnson, A Robert Kansky, Guide- 
lines for Evaluating Computerized Instructional 
, Material s « Reston, Virginia: National Council of 
^ Teachers of Mathematics^ 1981 ♦ 

This, is a very usably booklet, especially for the 
novice. The evaluation criteria are wel 1 devel- 
oped, with clear Explanations and examples, and 
the evaluation forms are simple and easy to com- 
plete. The guidelines are not math-specific and 
may be used effect i vely wi th courseware for any 
subject area. , (Available from the National Coun- 
cil of Teachers of Mathematics, 1906 Association 
Drive, Reston 7 , VA 22091.) 

Isaacson, Dan, , ''Courseware Review and Rating Form," 
The Computing Teacher (December 1979/January 1980) 
pp. 12-13'. 

This two-page form may be reproduced without fur- 
ther permission for classroom use. 

Kleiman, Glenn, Mary M. Humphrey, & Trudy Van Buskirk, 
"Evaluating Educational Software," Creative Com- 
puting (October 1 98 1 ) Dp. 85-90. 

Presents specific evaluation criteria, the in- 
structional rationale for each, and i 1 1 us t rat ions 
of both good and bad applications. 

Lathrop, Ann, "The Micro in the Media Center," Educa- 
tional Computer , (r.egular column in each issue) 

Includes review guidel ines, sources of reviews, 
and sample reviews of 1 ibrary-rel ated software, 
using various forms and checklists. 
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"A Level-headed £uide to Software Evaluation," Class- 
room Computer Hews (July-August 1 98 1 ) pp. 22-23. 

Presents sources\t*f published reviews, plus guide- 
1 ines for- conducting evaluations of educational 
programs, with an rindex-card format that can be 
reproduced for use in^any school. ^ — ~"~ 

MicroS I FT, The Evaluator 's \uide for Microcomputer- 
based Instructional Packages . Eugene, Oregon: 
The Computing Tegcher , 1981 

MicroS I FT has developed and' ^thoroughly fields 
tested th i s comprehens i ve ev^l uat ion document 
designed to establish a model ixf excellence in 
courseware. The guidelines and ^orms are more 
complex than those from the National Council of 
Teachers of Mathematics, but the user\who Studies 
them carefully will learn a great deal about eval- 
uation. Courseware developers will find x £his pub- 
lication especially helpful. (Avai 1 able \rom The 
. Computing Teacher , Department of Computer and In- 
formation Science, University of Oregon, Ei>qene, 
OR 97^03.) . \ 




Minnesota Educational Computing Consortium. Designing 
Instructional Computing Materials for Use with the 
Apple I I Microcomputer . St. Paul, Minnesota. 

Thi s authoring guide is a valuable source of 
detailed information on the criteria used in 
evaluating and developing courseware. (Available 



Peters, Harold, £ James Johnson. Author's Guide; 
Design, Development, Style, Packaging, Review . 
Iowa City, Iowa: CONDUIT. 

This publication is. written for designers and pro- 
grammers in the field of instructional computinq. 
(Available from CONDUIT, P. 0. Box 388, Iowa City, 
Iowa 5222A.) 
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n A Simple Way to Select Software, 11 Inst ructor (October 
1981) p. 9k. 

The program description/evaluation form is de- 
signed to fit a large index card. The 23 ques- 
tions about design and content are sel f -explan- 
atory and provide an easy overview of selection 
criteria; (Evaluation form is the same as one 
described in the Classroom Computer News article 
above.) 

Wade, T. E. , Jr. , "Evaluating Computer I nstruct ional 
Programs c nd Other Teaching Units, M Educational 
Technology (November 1980 ) pp. 32-35. 

Evaluation cr i teria are described in terms of 
relevant learning theories; includes a one-page 
evaluation checklist and a bibliography. 
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ATTACHMENT B 
SOURCES OF COURSEWARE REVIEWS 

Educational Computing Journals 



AEOS BULLETIN 

Association for Educational 

Oata Systems 
1201 Sixteenth Street, N.V. 
Washington, DC 20036 

AEOS MONITOR 

(see AEOS BULLETIN) 

CLASSROOM COMPUTER NEWS 
Box 266 

Cambridge, MA 02138 

THE COMPUTING TEACHER 
Department of Computer 

and Information Science 
University of Oregon 
Eugene, OR 97*03 ' 

EDUCATIONAL COMPUTER 
Box 535 

Cupertino, CA 95015 

ELECTRONIC EDUCATION 

1311 Executive Center Drive, 

Suite 220 
Tallahassee, FL 32301 

ELECTRONIC LEARNING 
902 Sylvan Avenue 
Englewood Cliffs, NJ 07632 

JOURNAL OF COMPUTERS IN 

MATHFMATICS t SCIENCE TEACHING 
Box ^55 

Austin, TX 78765" 

MICROCOMPUTERS IN EDUCATION 
.5 Chapel HI 1 1 Drive 
'fairfieH, CT 06*32 



MICRO-SCOPE 
JEM Research 
Discovery Park 
Universi ty of Victoria 
Box 1700 

Victoria, B.C. V8W 2Y2 
Canada 



Review Journals 
BOOKLIST 

50 East Huron Street 
Chicago, II 60611 

JEM REFERENCE MANUAL 
JEM Research 
Discovery Park 

Universi ty of Victoria / 
Box 1700 

Victoria, 8.C. V8W 2Y2 
Canada 

JOURNAL OF COURSEWARE REVIEW 

(ApplH 
The Apple Foundation 
Box ?8*26 

San Jose, CA 95159 

MlCRO'SlFT REVIEWS' 

Northwest Regional Educational 

Laboratory 
300 S.u. Sixth Avenue 
Portland, OR 97202+ 



PEELINGS II [Apple! 

9^5 Brook Circle 

Las Cruces, NM 88001 
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PIPELINE 
Condui t 

University of Iowa 
Box 388 

Iowa City, 1A 52244 

"PURSER'S ATARI MAGAZINE 
Box 1*66 

El Dorado, ,CA 95623 

PURSER'S MAGAZINE 

(see PURSER'S ATARI MAGAZINE) 

SCHOOL MICROWARE REVIEWS 
Dresden Associates 
Box 246 

Dresden, ME 04342 

SOFTWARE REVIEW 
Microform Review 
520 Riverside Avenue 
Vestport, CT 06880 



Newsletters From Educational 
Users' Groups 

CHICATRUG NEWS (TRS-80l 
Chicago TRS-80 Users Group 
203 North Wabash, Room 1510 
Chicago, IL 60601 

CUE NEWSLETTER 
Computer-Usino Educators 
Box 18547 

San Jose, CA 95158 

MACUL JOURNAL 

Michigan Association for 

Computer Users in Learning 
Wayne County ISD 
33500 Van Born Avenue 
Wayne, Ml 48l84 
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MIDNIGHT SOFTWARE GAZETTE [PET] 
Central Illinois PET Users' Group 
635 Maple Court 
Mt. Zion, IL 62549 

USER f S: THE MECC INSTRUCTIONAL 

COMPUTER NEWSLETTER 
2520 North Broadway Drive 
St. >aul, MN 55113 



Educat ional Journal s 

ARITHMETIC TEACHER 

National Council of Teachers 

of Mathemat ics 
1906 Association Drive 
Reston, -VA 22091 

EDUCATIONAL TECHNOLOGY 
140 Sylvan Avenue 
Englewood CI iffs, NJ 07632 

EPIE REPORT 
EPIE Institute 

box no 

Stony Brook, NY 1 1790 

INSTRUCTOR 
7 Bsnk Street 
Dansvi Me, NY 14437 

MATHEMATICS TEACHfP 

(ser ARITHMETIC TEACHER) 

^EOIA t METHODS 

Walnut Street. 
Phi UfVlphia, PA J rt l02 



Comput'er Journals 
BYlfc 

70 Main Street 
Peterborough, NH 03458 
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COMPUTE! 

Box 5 l 'M 

Greensboro, NC 27*»03 

CREATIVE COMMUTING 
Box 789-M 

Morristown, NJ O769O 

80 MICROCOMPUTING (TRS-80) 
80 Pine Street 
Peterborough, NH 03*»58 

INFOVORLD 

375 Cochituate Road 
Box 880 

Framingham, MA 01701 

INTERFACE AGE 

16704 Marquardt Avenue 

Cerritos, CA 90701 

MICROCOMPUTING 

(see 80 MICROCOMPUTING) 

PERSONAL COMPUTING 

50 Essex Street 

Roche! le Park, NJ 07*62 

POPULAR COMPUTING 
(see BYTE) 

S0FTSI0E 

Box 68 

MM ford, NH 0305^ 

S0FTALK MAGAZINE [Apple! 
11021 Magnolia Boulevard 
North Hollywood, CA 91601 
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The four demonstrations presented at the confer- 
ence represented a variety of approaches to teaching 
compos i t ion and its related form sk i 1 1 s. Sampl e 
materials ranged from a highly structured grammar 
module to an open-ended program for composing poetry. 
With the field of computer-based composition instruc- 
tion still in its, infancy, such diversity seems to be a 
healthy sign. The powerful capabilities of the 
computer al low — and even encourage — a var iety of 
strategies for organizing instruction. The programs 
described below illustrate some of these strategies. 

MICHAEL SOUTHWELL 

(YORK COLLEGE, CITY UNIVERSITY OF NEW YORK) 

Soqthwell's demonstration featured one of the ten 
computer-assisted grammar lessons that he has devised 
for developmental writers at the City University of New 
York (CUNY). These lessons are designed to be used in 
an autotutorial writing laboratory. Southwell and his 
colleagues at CUNY have found that basic writers who 
speak dialects other than standard English can benefit 
from di rect instruct ion on the form and syntax of 
written English. Such instruction, they claim, is most 
effective in a laboratory setting, where the student 
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controls the pace of the instruction and assumes 
primary responsibility for learning.* 

Since the CUNY grammar lessons are designed for a 
laboratory environment, the programs are entirely self- 
contained, requiring little or no intervention by the 
teacher. The sequence of activities is carefully con- 
trolled, and students must complete each module suc- 
cessfully before going on to the next. This control is 
maintained through the use of a "password, 11 which the 
program gives the student after he or she has success- 
fully completed a module. This password must then be 
entered by the student at the beginning of the next 
lesson. 

Although the CUNY grammar lessons were originally 
written for a mainframe computer, Southwell is cur- 
rently adapting them for a microcomputer. The micro- 
computer versions of the lessons feature the use of 
color graphics and sound to reinforce learning. The 
programs present explicit instruction on identifying 
parts of speech, using correct word forms (e.g., noun 
plurals, verb tenses), and manipulating sentence struc- 
ture. The programs rel/ heavily on students 1 entering 
complete sentences, and these sentences must correspond 
exactly to the desired response. Typographical errors 
and misspel 1 ings--as well as grammatical errors— el ici t 
an "incorrect answer" response from the program. 
Southwell claims that this technique encourages stu- 
dents to be more attentive to the learning task. (For 
further information, see Southwell's article, "Using 
Computer-assisted instruction for Developmental 
Writers," AEDS Journal , 1982, J5, pp. 80-91-) 

STEPHEN MARCUS 

(UNIVERSITY OF CALIFORNIA AT SANTA BARBARA) 

The writing program developed by Stephen Marcus 
illustrates a completely different strategy for using 

*Addi tional information on the CUNY writing pro- 
gram is provided by Mary Epes in "Developing New Models 
of the COMP-LAB Course," in Moving Betw een Practice and 
Research in Writing , edited by Ann Humes; Los Alamitos, 
CA: SWRL Educational Research and Development, 1981. 
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the computer in compos ft ion instruction. Marcus has 
designed a program' called Com pu poem , which allows 
students to compose original poems on the computer.* 
The program asks students to supply various parts of 
speech, which are then formatted by the machine to 
produce a poem. - Students have the option of revising 
the structure an<3 wording of their poems, and they can 
al so print out a hard copy of thei r creat ions. For 
example, the following poems were written by students 
using Com pu poem : 

Paul 's Poem 
The riveter, 

Brawny, sweatcaked at Miller Time 
Careful ly slouches 
Beth lehembound 



Harold's Poem 

The repti 1 ian brain 
iweet, juicy 
' * in the nick of time's swamp 
graceless ly 
beckons. 

Com pu poem is a unique appl i cat ion of computer- 
based writing instruction because it encourages stu- 
dents to write without worrying about evaluation. 
Compupoem al lows students to discover what they have to 
say as they are in the process of composing. Such 
experiences can help reluctant writers overcome their 
"wrjter's block," encouraging freer expression and 
experimentation. (For additional information on 
Compupoem, see The Computing Teacher , March, 1982, pp. 
28-3TT ! ~ 

IRENE AND OWEN THOMAS 

(IOTA, LAGUNA BEACH, CALIFORNIA) 

Irene and Owen Thomas demonstrated several 
programs they are currently preparing for commercial 



*The original program on which Compupoem is based 

can be found in BASIC and the Personal Computer , by T. 

Dwver and M. Critchfield; Menlo Park, CA: 
r « ison-Vesley, 1978. 
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distribution. The Thomases 1 presentation featured 
several of their spelling programs, which are highly 
interactive, taking advantage of color graphics, sound, 
special character fonts, and a variety of response 
formats. The Thomases emphasized that the tone of a 
program's response to students' errors must be con- 
trolled carefully. Students need to be told that their 
answer is incorrect, but the message should not be 
insulting or negative. Another program demonstrated by 
the Thomases provides instruction on punctuation rules. 
Students practice applying these rules by punctuating a 
letter. 

The Thomases also demonstrated a sentence-com- 
bining program, which teaches students how to combine 
several short sentences into one sentence. Since this 
program is designed for the elementary level, it 
attempts to minimize the need for typing skills by 
providing alternative response formats. For example, 
the student may construct a sentence by moving a box 
'through a word list, selecting, in order, the words for 
the sentence; or the student may move an arrow through 
a sentence and press RETURN at the point where a spe- 
cific word should be inserted. 

Eventually, the Thomases hope to develop a compre- 
hensive computer-based wri ting program, which wi 1 1 
include prewriting activities, a word processor, and an 
"electronic handbook' 1 for help in revising and editing. 

SHIRLEY KERAN 

(MINNESOTA EDUCATIONAL COMPUTING CONSORTIUM) 

Programs demonstrated by Shirley Keran, of the 
Minnesota Educational Computing Consortium (MECC), are 
designed primarily for el ementary- level language arts 
instruction. Ai though these programs might not 
strictly classified as composing activities, they do 
provide instruction on the form skills that are needed 
to prepare written documents. For example, MECC spell- 
ing drills provide practice in choosing a correctly 
spelled word to fit into a sentence. The program 
allows teachers to enter the words and sentences the 
student will use. In addition, the program also keeps 
track of each student's performance so that instruction 
can be modified to meet individual needs. 
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Other programs developed by MECC allow the teacher 
to design word games that are printed out in hard copy. 
Crossword puzzles, word mazes, and "hangman" games can 
easily be constructed and customized to fit the needs 
,of the classroom. Such games can be useful for teach- 
ing vocabulary and spelling — subjects that many stu- 
dents may otherwise find tedious. 

Also included in Keran's presentation was a demon- 
stration of a computer-based social studies game called 
Voyageur . The game simulates the experiences ^of fur 
traders who traveled by canoe in the Great Lakes area 
during the 18th and 19th centuries. Students are 
required to organize and lead a trading expedition, and 
they must make critical decisions about how to proceed 
on their journey. 

In addi t ion to their obvious vaJue in teach ing 
content-area material, such simulations may also have 
additional benefits for teaching writing. First, simu- 
lations promote the use of problem-solving skills--the 
same kinds of skills that students must apply when they 
write. Moreover, simulations demand precise communica- 
tion. Ambiguous or illogical commands cannot be pro- 
cessed by the machine, so students quickly learn that 
they must express their intentions clearly and simply. 
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Alfred Bork 
University of California it Irvine 



I'm going to direct many of jny comments toward 
issues of development, because I am assuming that many 
of you are developers or are going to become developers 
of computer-based learning material. I am ,also going 
to object a little bit to the title of this conference 
The title includes the word instruction — a word I have 
removed from my vocabulary* I think of things like 
instruction and teaching as very uninteresting. One of 
the problems in education is that we are much too con- 
cerned about teaching and not enough concerned about 
learning. So 1*21 concentrate on learning. 

BAD PRACTICES 

I want to start with a brief list of bad practices 
in computer-based learning. As developers, we must be 
aware of such practices so that we can avoid them in 
our materials. If you look at materials generally, you 
witi find that these bad features are very common. 

Screen Design 

The first set of issues in my compendium of bad 
practices deals with screen design—particularly hin- 
drances to readability on tije screen. We have to 
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remember that blank space is free on the computer, 
unlike print media. Many designers come into this 
field with a book mentality, and they tend to show 
thk>gs the way they would look in books. For example, 
long lines are something we don't need in computer- 
based materials. Readability research generally shows 
that, short lines aid readability. We sometimes see 
words being split arbitrarily at the end of the screen. 
That should never happen in a student-usable program. 
A similar problem arises when users input text. Gen- 
erally, the input does not use "word wrap" techniques. 
Oevelopers of word processing systems learned long ago 
that this Is a poor practice, it's easy to build soft- 
ware that automatically moves complete words to the 
next 1 ine on the screen. 

We also frequently see computer dialogues putting 
almost all text at the left margin--another print tech- 
nique. Many computer languages assume that you^will 
always want to put text at the left margin. But when 
you start using more blank space, you will want to bal- 
ance material on the screen, and you will seldom put 
anything at the left margin. More generally, there 
isn't much conscious placement of text in many mate- 
rials that exist today. Most people are unfortunately 
just letting the system put text wherever it happens to 
put it. 

Another thing we see frequently is splitting nat- 
ural phrases across a line. Studies again show that 
this is a deterrent to readability. Given that blank 
space is free on the computer, there is no reason that 
we can't display text logically, keeping natural 
phrases together on a line. 

In addition, much of the text we see is displayed 
too F ast* Our stud'e^ have shown that novice users 
don't Tike this rapid text display. Given a choice of 
where to set the speed of text, such users set it at a 
much slower rate. Good programs will allow users to 
set the rate of the text display. This is not diffi- 
cult to build into the software. 
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Timing 

Timing is another important issue in the design of 
computer-based materia 1 In most envi ronments, we 
cannot assume that pecpie are going to be there for- 
ever. If a user doesn't know that h£ or she needs to 
press RETURN (or some other key) to continue, the 
machine should tell the user to press RETURN, in addi- 
tion, there may be instances when you need to .;ime the 
student's response. But this has to be done in a sen- 
sitive fashion. That is, if a student waits nine sec- 
onds, and then starts to type, we don't want to cut him 
or her off just because we were waiting ten seconds. 

Content 

Next, let me look at a few content issues that are 
also in my compendium of bad practices. First, it 
seems fair to say that the vast, majority of the pro- 
grams currently available are trivial . programs. That 
is, they are not really serious curriculum efforts* 
This abundance of; trivial programs has probably 
occurred because we are at a very early stage of devel- 
opment. As we gain more experience in designing 
computer-based materials, we should start moving away 
from trivial applications. 

Another issue related to content concerns "help" 
sequences. For the most part, these sequences are not 
very helpful. They are usually completely noninter- 
active. Often a help sequence is simply a full screen 
of verbal material to read. Help sequences can be just 
as interactive as the rest of the material. 

Media Issues 

The fourth category in my compendium of bad prac- 
tices includes media issues. Most computer materials 
we see today look like a book. Part of this comes from 
the fact that there is not enough visual material. 
Instruct- are extremely verbally oriented, and they 
often -1 . understand the visual needs of students. 
As many or you have undoubtedly discovered, not all 
students are verbal ly oriented. 
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Another important media issue is solving design 
problems with other media- I get very worried when I 
am making a film and somebody brings up a problem and a 
designer says, "Oh, we'll put it in the student hand- 
book. 11 1 get very worried when someone designing a 
computer progr6m is asked a question about it and says, 
"Oh, that's covered in the teacher's guide." I get 
suspicious when designers have to solve problems with 
other ki nds of medi a. 

Another major media issue is the amount of inter- 
action. The .real advantage of the computer is that it 
is an interactive medium. However, most teachers tend 
to come from successful environments of lecturing, 
where they don't think and work interactively. Conse- 
quently, computer-based materials tend to look like 
books. Much more interaction is needed. 

Genera! Issues 

-4n any interactive learning material, we ought to 
use English as the medium of communication. This busi- 
ness of using Y and N and special letters as responses 
seems to be a questionable strategy. The English lan- 
guage is a perfectly reasonable tool to use, ^and I 
don't think we need "computerese." If we don't use 
good form in the material, how can we expecfl students 
to use good form? 

Another issue is the use of mOl tiple-ch^ice for- 
mats. Multiple choice came about as a tactic of des- 
peration for dealing with large numbers of students. 
But we don't need multiple choice on the computer. 
This isn't to say that we might not occasionally want 
to use it just for variation, but as a general rule, 
multiple choice is a terrible strategy. 

DEVELOPING MATERIALS 

I would .like to turn now to a discussion of the 
principles that should guide our development efforts. 
It makes sense to begin by examining the strengths of 
the computer as an instructional medium. 

First, the computer is an interactive medium--and 
O interaction is not just a word. In .fact, I believe 
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that we can measure interaction. We can look at com- 
puter material and talk about the qual i ty of inter- 
action. Interaction doesn't just mean that the user 
gets to say yes or no every few minutes while reading* 
We can look at how frequent 1 y i nteract ion occurs, we 
can look at the types of interaction, and we can begin 
to arrive at measures of interaction* 

The second major strength is the computer's capa- 
bility for individualization* if computer material is 
good, i t can real ly begin to do what we 1 ve always 
talked about in education — individualize the learning 
experience. We can make the learning experience dif- 
ferent for different people. 

Another strength of the computer i s that i t can 
present us with new ways to organize learning* This is 
probably the hardest thing for the conventional teacher 
to understand. Often the computer allows entirely dif- 
ferent strategies for organizing our material* 

The Development Process 

Development i s a serious process — not something 
that can be done casually. If one is going to develop 
learning material of any kind, one doesn't do it by 
finding a teacher and letting that teacher do it in his 
or her spare time. The notion that we can easily pro- 
duce good learning material is an illusion* 

In serious development efforts, we need groups. 
We can't assume that a good teacher is going to be a 
good programmer, just as we can't assume that a good 
teacher knows how to run linotype machines and printing 
presses if we are developing textbook material . We 
need to look at the places where serious curriculum 
development takes place. My favorite example is the 
Open University in England. The Open University typ- 
ically spends a million dollars on developing a course 
these days. The University runs the course for seven 
years, and then scraps it and spends another million 
dollars. We are not going to get good computer-based 
learning material until we also begin to develop at 
that level* 
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Instructional designers ought to stop thinking 
^bout programming. For the most part, the people who 
w\ite textbooks don't learn how to run printing 
presses. And the people who are going to design good 
computer-based learning material are not going to be 
computer experts. Programming is a technical area, and 
as we\et into commercial production, where issues of 
transportability to new machines are extremely impor- 
tant, we\are going to have to separate instructional 
design frota technical production, much as we do now 
with books\ films, and almost every other kind of 
learning medium. 

Research Needs \ 

Perhaps the most important issue in developing 
computer-based materials is establ ishing a research 
basis. For example\ th.is has been a conference on 
writing. What do we ktaow about writing? What is the 
experimental evidence? \what research do we need to 
conduct in order to desigr\successful materials in this 
area? Who are the expertsNin teaching writing and who 
are the experts in res<*arcH\ associated with writing? 

8ob Shost3k has all ready \oted the problems in 
teaching writing. This 'seems to\be a very col id place 
to begin our development efforts.X We shouldn't start 
by saying, "What can I ,do with computers?" Rather, we 
should start by asking, "What are my pedagogical diffi- 
culties? What are the problems associated with teach- 
ing writing?" it may turn out that computers are going 
to be extremely useful (as I believe the^will be) in 
dealing with these problems. \ 
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The Future 

As developers, we need to have a very strong\ori 
entation toward the future. The problem is not whatswe 
can get into classrooms tomorrow. The really interest; 
ing things are future-oriented. We are at the thresh-> 
old of a real revolution in the way people !earn--a 
revolution that is going to influence our entire educa- 
tional system. We ought to look very much into the 
future, and there are several implications to this ori- 
entation. For example, if you are a developer, you 
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don't want to develop materials for the kind of hard- 
ware that is currently available. Such machines are 
likely to be obsolete within a few years. 

We also need to think more about non-school envi- 
ronments. Too much of our thinking about computers 
concentrates on schools, and we often hear people say, 
n Will teachers accept this? 11 In fact, teacher accep- 
tance may not- be very critical in this area. As com- 
puters become more common in homes, learning material 
will become an important component in selling comput- 
ers. Consequently, commercial interest in learning 
will be great, and our whole attitude toward education 
will change. 

I would like to raise an additional issue for you 
to ththk about. I have already pressed the notion that 
the computer. can really lead to new ways of organizing 
instruction, new ways of doing things. Now I raise the 
question of whether reading and writing really are sep- 
arate activities. Or are they really things that can 
be done together on the computer, rather than being 
done separately? Interestingly, the most extensive 
early work involving the computer and typewriters, 
0. K. Moore's "talking typewriter" study, was really a 
reading project rather than a writing project. This 
early work showed that you can teach very young chil- 
dren to typfc, and that you can use typing as a vehicle 
for teaching reading. If we begin to think about the 
computer as a "combining" device, then perhaps we can 
approach reading and writing as fundamentally the same 
act i vi ty . 

Finally, I always like to remind people that it is 
not clear that the computer is going to improve educa- 
tion. The computer, like any new technology, has the 
potential for improving, education or weakening educa- 
tion. Everyth ing i n human technology has thi s dual 
potential. When humans first learned to use fire, they 
found that fire could be used for good or for bad. The 
technology itself doesn't determine whether it is going 
to be good or bad. People do. And we have to remember 
that the computer is a gift of fire. 



O 73 

AC ? i 



APPENDIX: 
EVALUATING TEXTUAL 
RESPONSES 



Joseph Lawtor 
SWRL Education*! Research and Development 



Under a contract with the National Institute of 
Education, my colleagues and I here at SWRL have been 
investigating the use of microcomputers to teach writ- 
ing. The purpose of our investigation has been to 
explore ways in which the computer might be useful for 
teaching the high-level skills that are associated with 
composing.* Although much of our work has been explor- 
atory, our experiences in designing interactive writing 
materials may be of interest to developers— or poten- 
tial deve lopers— of computer-based writing instruction. 

When we began our project, one of our first tasks 
was to find, out what, kind of instructional programs 
were currently avai lable for teaching wr it ing. Not 
surprisingly, we found the field to be very limited. 
Most of the available courseware was of the drill -and- 
practice variety, dealing primarily with the form 

*Add i tional information on this project can be 
found in "Us?ng Microcomputers for Composition Instruc- 
tion, u by Bruce Cronnell and Ann Humes (ERIC Document 
Reproduction Services No. . ED 203 872). 
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skills of writing, such as spelling, usage, and capi- 
talization. Although such programs can be useful, very 
few of them require "the student to write anything 
longer than a single word. In fact, since many of the 
programs employ multiple-choice formats, the student 
commonly responds by simply typing a single letter or 
number. 

However, when students write, they are expected to 
produce sentences and paragraphs, not s ingle words or 
letters. Consequently, we decided to focus our efforts 
on designing computer-based materials that would re- 
quire the actual production of text. And we also felt 
that our programs should be able to evaluate that text. 

After exploring a number of ideas for instruction, 
we decided that our initial effort would be to design a 
program for teaching sentence combining. There were 
several practical reasons for this decision. First, 
sentence combining has been shown to be an effective 
technique for Improving the sentence structure of stu- 
dents' writing. Second, after reviewing tFje Research 
on sentence combining, we had a pretty good idea of 
what the scope and sequence for sucfr a program should 
be. And finally, we felt that, while sentence-combining 
instruction would allow jjs to work with textual re- 
sponses, it would also allow us to limit the range of 
those responses, making the evaluation task more man- 
ageable. 

EVALUATING STUDENT RESPONSES 

As the framework for our sentence-comb in ing pro- 
gram began to take shape, we soon discovered that 
evaluating students' responses was not going to be an 
easy task. The computer--for all its remarkable elec- 
tronic sophistication--hasn't the faintest idea of what 
a sentence (or even a word) is. When a computer stores 
text in its memory, it stores the text simply as a 
''string 11 of characters, that is, a particular sequence 
of letters, spaces, and symbols. Although the machine 
does not "know" what the string means,' it can compare 
one string to another and determine whether or not the 
two are equal (i.e., whether or not the strings cpntain 
exactly the same characters in exactly the same se- 
quence). Consequently, the easiest way to evaluate the 
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student's response would have been to compare the stu- 
dent's sentence to the correct answer. If the two 
strings were not equal, the machine could then tell the 
student that his or her answer was wrong and branch to 
some type of remedial instruction. 

However, we fe 1 t that there were degrees of 
n r ightness 11 and "wrongness" that had to be considered 
in evaluating the student's response. For example, in 
the following item, a student who had correctly com- 
bined sentences (1) and (!) would produce sentence (3): 



(3) Tom fell to the ground and ripped his 

uniform.* 

But consider the following hypothetical responses: 

(4) Tom fell to his uniform. 

(5) torn fell to the grond and ripped his unifrm 

To the computer, both of these responses would look 
equally wrong; neither of them would match the correct 
answer. Yet there are important d if ferences between 
the two responses. A student who enters the first 
sentence evidences little or no understanding of the 
sentence-combining instruction. But a student who 
enters the second sentence seems to comprehend the 
material; errors in the second sentence reflect spell- 
ing, capitalization, or typing problems — not problems 
with sentence combining. 



*This item format was originally developed by Frank 
O'Hare ( Sentence Combining; Improving Student Writing 
without Formal Grammar Instruct ion . Urbana, I L: Na- 
t ional Counc i 1 of Teachers of Eng I ish, 1973) * The 
parenthesized word is a "signal" that tells the student 
how to combine the sentences. In this case, the stu- 
dent is to conjoin the two predicate phrases with and . 



(i) 



Tom fell to the ground. 



(2) 



Tom ripped his uniform, (and) 
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Clearly, a simplistic evaluation of the student's 
response was not appropriate for our sentence-epmb in ing 
program. What we needed was a system for "parsing 11 the 
student's sentence— a system that would examine the 
sentence and distinguish among the various types of 
errors a student might make.* 

DESIGNING THE PARSER 

We began specifying the functions of our parsing 
system by class ify ing the errors that students might 
make into two broad categories. The first we called 
"syntax" errors— errors that reflected a misunder- 
standing of the sentence-confcining task, as exemplified 
by response {k) above. The second category included 
errors of form (spelling, typing, capitalization, 
punctuation), as illustrated by response (5). A stu- 
dent whose response contained a syntax error was to be 
routed back through remedial instruction. However, a 
student whose sentence contained only errors of form 
was to be allowed to fix those errors until the sen- 
tence matched the desired response. 

Several of the parsing routines were relatively 
easy to specify. As it is now written, the program 
first checks for a capital letter at the beginning of 
the student's sentence. If the first letter is not a 
capital, the program asks the student to make the nec- 
essary correction. If the student does not change the 
letter at this point, the program will automatically 
make the correction. A similar routine checks for the 
presence of a period at the end of the sentence. 

*The term parsing as used here does not refer to 
formal grammatical analysis. Although computer pro- 
grams have been developed that can perform such anal- 
yses, these programs normally require extensive amounts 
of computer memory— more memory than is available in 
the microcomputer with which we were working. For a 
review of recent developments in the field of computer- 
based grammatical analysis, see Hendrix, G. , and 
Sacerdoti, E . , "Natural Language Processing: The Field 
in Perspective, u Byte , September, 1981. 
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The next parsing routine checks for the presence 
of the sentence-cctnb ining M signal" in the student's 
sentence* If che signal is not present, the program 
asks the student to. add it* At this point, if the 
student does not add the signal, the program detects a 
syntax error and branches to the remedial instruction. 

Nextj the program counts the number of words in 
the student's sentence* (A word is defined as a series 
of letters followed by a space, or, in the case of the 
last word in the sentence, followed by a period.) if 
the number of words in the student's sentence does not 
correspond to the number of words in the correct re- 
sponse, the student is informed of the discrepancy and 
asked to revise his or her response* Failure to revise 
the sentence correctly results m a syntax error and a 
branch to remedial instruction* 

At this point in the evaluat ion--i f the student 
has not been routed back through the remedial instruc- 
tion because of a syntax error — the student's sentence 
now contains an initial capital letter, a terminal 
period, the sentence-combining signal, and the correct 
number of words. All that remains now is to check for 
spelling errors* Although checking for such errors 
would seem to be a relatively straightforward task, we 
found that this was actually one of the most compli- 
cated routines in the whole program. We wanted the 
spelling routine to examine each word in the student's 
sentence, compare it to the corresponding word in the 
correct answer, point out any word that was misspelled, 
and ask the student to correct the misspelling. We 
also wanted the routine to include a spelling correc- 
tor—that is, if the student did not correct the word 
on the first attempt, we wanted the program to correct 
the word automatically, so that students would not get 
bogged down in endless editing tasks, which would con- 
tribute little to the pr imary purpose of the instruc- 
t ion. 

The major problem we encountered in designing this 
routine was defining a spelling error. Consider, for 
example, the following responses to the item listed 
above. Both of these responses would have passed 
through the previous parsing routines: 
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(6) Tom fell to the ground and he fell down. 

(7) Tom fell to the grond and ripped his unifrm. 

Obviously, the errors in sentence (6) are not spelling 
errors. 8ut to the computer they might appear to be. 
For example, when the machine compares the seventh wore 
in the student ! s sentence (he) to the seventh word in 
the correct answer ( ripped ), the computer will detect 
only that the two words are not identical. Without ad- 
ditional programming, the computer cannot tell whether 
the student's word is misspelled or whether it is' sim- 
ply the wrong word. Consequently, we had to develop an 
additional parsing routine to examine each word In the 
student's sentence, letter by letter. We then defined 
"spelling" errors as discrepancies that resulted from 
one of the following conditions: 

• The word contains one letter that is dif- 
ferent from the corresponding letter in 
the correct word (e.g., grount for 
ground ) . 

• The word contains one letter too many 
(e.g., qeround ) or one letter too few 
(e.g. , qroun ). 

• The word contains one pair of transposed 
letters (e.g. , gruond ). 

Al 1 other discrepanc ies in the student's text are 
treated as syntax errors. Thus, when the computer 
encounters the word he in sentence (6), the student is 
sent to the remediation routine. However, the discrep- 
ancies in sentence (7) are treated as spelling errors: 
The student is asked to correct the errors, and the 
program then proceeds to the next activity in sequence. 



CONCLUSIONS 

Our experience in designing the sentence-combining 
program has led us to form several conclusions about 
computer-based composition instruction— cone lus ions 
that are likely to have important implications for sub- 
sequent development efforts in this field. First, 
O designing interactive programs that evaluate textual 
ERiC responses is not a simple task. Programs that require 
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only minimal responses from students— enter ing a single 
word, a letter, or a number--can eval£*a'te those re- 
sponses quickly and easily. However, extended textual 
responses demand more complex evaluation. Even in our 
sentence-combining program, where student input is rea- 
sonably constrained, evaluation must distinguish among 
many different types of errors, responding to each type 
in a different way. Imagine the complexity that would 
be involved in evaluating less constrained responses, 
for example, a narrative paragraph that must be checked 
for appropriate transitional expressions. 

Another conclusion we have drawn from our experi- 
ence is that no matter how sophisticated our evaluation 
techniques, become, they will still not account for al 1 
the responses that students might possibly make. The 
best we can hope for is a reasonable compromise. An 
evaluation routine has to be flexible enough to handle 
a variety of error types, but it must not be so flex- 
ible that it allows faulty input, such as typing grated 
for ground . In evaluating textual responses, we have 
to remember that there are definite limits to what we 
can do. 

Final ly— and perhaps most importantly— we have 
found that the extra effort required to design sensi- 
tive evaluation routines pays off in the long run. 
Students who' part ic ipated in pilot studies of our sen- 
tence-combining program seemed to appreciate the way 
their errors were handled. Most of the students were 
very willing to revise their sentences once the com- 
puter provided the appropriate prompt. Students tended 
to view the computer as a partner rather than as an 
adversary, and, after all, that is precisely what a 
good composition teacher should be. 
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